Sep 01 11:15:29 devstack cinder-volume[76143]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 11:15:29 devstack cinder-volume[76143]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 11:15:29 devstack cinder-volume[76143]: we strongly recommend against using it for new projects. Sep 01 11:15:29 devstack cinder-volume[76143]: If you are already using Eventlet, we recommend migrating to a different Sep 01 11:15:29 devstack cinder-volume[76143]: framework. For more detail see Sep 01 11:15:29 devstack cinder-volume[76143]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 11:15:29 devstack cinder-volume[76143]: import eventlet # noqa Sep 01 11:15:31 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:15:31 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:15:31 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:15:32 devstack cinder-volume[76143]: INFO dbcounter [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Registered counter for database cinder Sep 01 11:15:32 devstack cinder-volume[76143]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76143) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:15:32 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writer thread running {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:15:32 devstack cinder-volume[76143]: INFO cinder.rpc [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 11:15:33 devstack cinder-volume[76143]: INFO cinder.rpc [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76143) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:15:33 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Determined volume DB was empty at startup. Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG cinder.volume.manager [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76143) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 11:15:33 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 11:15:33 devstack cinder-volume[76143]: WARNING stevedore.named [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 11:15:33 devstack cinder-volume[76143]: WARNING castellan.key_manager [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:15:33 devstack cinder-volume[76143]: WARNING cinder.keymgr.conf_key_mgr [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG cinder.volume.drivers.lvm [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76143) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_concurrency.processutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] CMD "cinder-rtstool verify" returned: 0 in 0.414s {{(pid=76143) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76143) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:15:33 devstack cinder-volume[76143]: INFO cinder.rpc [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 11:15:33 devstack cinder-volume[76143]: INFO cinder.rpc [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 11:15:33 devstack cinder-volume[76143]: WARNING stevedore.named [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 11:15:33 devstack cinder-volume[76143]: WARNING castellan.key_manager [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:15:33 devstack cinder-volume[76143]: INFO cinder.volume.manager [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76143) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:15:33 devstack cinder-volume[76143]: INFO oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Starting 1 workers Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Started child 76304 {{(pid=76143) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Full set of CONF: {{(pid=76143) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] ******************************************************************************** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Configuration options gathered from: {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] ================================================================================ {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] allow_availability_zone_fallback = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] allow_compression_on_image_upload = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] allowed_direct_url_schemes = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] api_rate_limit = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] auth_strategy = keystone {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] az_cache_duration = 3600 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_availability_zone = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_host = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76304]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_stats_polling_interval = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backup_api_class = cinder.backup.api.API {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backup_name_template = backup-%s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backup_use_same_host = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backup_use_temp_snapshot = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] chap_password = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] chap_username = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_internal_tenant_project_id = f8778c66e9ad43f28dcc134695a35837 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_internal_tenant_user_id = a8cd54c2df804097b8cc4bdc2e99f02a {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cloned_volume_same_az = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cluster = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] compression_format = gzip {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] compute_api_class = cinder.compute.nova.API {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] config_dir = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] config_source = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] control_exchange = openstack {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] debug = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] default_availability_zone = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] default_group_type = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] default_volume_type = lvmdriver-1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] disk_geometry = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] driver_client_cert = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] driver_client_cert_key = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] driver_data_namespace = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] driver_ssl_cert_path = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] driver_ssl_cert_verify = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] driver_use_ssl = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] enable_force_upload = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] enable_new_services = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] enable_unsupported_driver = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] enabled_backends = ['lvmdriver-1'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] enforce_multipath_for_image_xfer = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] filter_function = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_api_insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_api_ssl_compression = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_ca_certificates_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_catalog_info = image:glance:publicURL {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_num_retries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance_request_timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] goodness_function = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] graceful_shutdown_timeout = 5 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] group_api_class = cinder.group.api.API {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] host = devstack {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_compress_on_upload = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_conversion_address_space_limit = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_conversion_cpu_limit = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_conversion_disable = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_upload_use_cinder_backend = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_upload_use_internal_tenant = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_volume_cache_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_volume_cache_max_count = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] image_volume_cache_max_size_gb = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] init_host_max_objects_retrieval = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] instance_format = [instance: %(uuid)s] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] iscsi_target_flags = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] iscsi_write_cache = on {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] iser_helper = tgtadm {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] iser_ip_address = 192.168.122.48 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] iser_port = 3260 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_color = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_config_append = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_dir = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76304]: INFO cinder.volume.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_options = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_rotate_interval = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_rotate_interval_type = days {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] log_rotation_type = none {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] max_age = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] max_logfile_count = 30 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] max_logfile_size_mb = 200 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] max_over_subscription_ratio = 20.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] message_reap_interval = 86400 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] message_ttl = 2592000 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] migration_create_volume_timeout_secs = 300 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] monkey_patch = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] monkey_patch_modules = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] my_ip = 192.168.122.48 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] no_snapshot_gb_quota = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] num_iser_scan_tries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] num_shell_tries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] num_volume_device_scan_tries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] nvmeof_conn_info_version = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] nvmet_ns_id = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] nvmet_port_id = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_max_limit = 1000 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_volume_ext_list = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_volume_listen = 0.0.0.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_volume_listen_port = 8776 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_volume_use_ssl = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] osapi_volume_workers = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] per_volume_size_limit = -1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] periodic_fuzzy_delay = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] periodic_interval = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] project_id_regex = [0-9a-f\-]+ {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] public_endpoint = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] publish_errors = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_backup_gigabytes = 1000 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_backups = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_gigabytes = 1000 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_groups = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_snapshots = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] quota_volumes = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] rate_limit_burst = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] rate_limit_except_level = CRITICAL {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] rate_limit_interval = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] reinit_driver_count = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] replication_device = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] report_discard_supported = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] report_interval = 120 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] reservation_clean_interval = 86400 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] reservation_expire = 86400 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] reserved_image_namespaces = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] reserved_percentage = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] rpc_response_timeout = 120 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] run_external_periodic_tasks = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] scst_target_driver = iscsi {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] scst_target_iqn_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_down_time = 720 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] shell_completion = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] snapshot_name_template = snapshot-%s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] snapshot_same_host = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] split_loggers = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] state_path = /opt/stack/data/cinder {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] storage_availability_zone = nova {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] storage_protocol = iSCSI {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] syslog_log_facility = LOG_USER {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] target_helper = lioadm {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] target_ip_address = 192.168.122.48 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] target_port = 3260 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] target_protocol = iscsi {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] target_secondary_ip_addresses = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] trace_flags = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] transfer_api_class = cinder.transfer.api.API {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] transport_url = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] until_refresh = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_chap_auth = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_default_quota_class = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_journal = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_json = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_multipath_for_image_xfer = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_stderr = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] use_syslog = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] verify_glance_signatures = enabled {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_api_class = cinder.volume.api.API {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_backend_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_clear = zero {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_clear_ionice = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_clear_size = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_copy_bps_limit = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_dd_blocksize = 1M {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_name_template = volume-%s {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_service_inithost_offload = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volume_usage_audit_period = month {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] zoning_mode = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_concurrency.disable_process_locking = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.auth_section = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.auth_type = password {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.auth_version = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.cache = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.delay_auth_decision = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:33 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.http_connect_timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.include_service_catalog = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.interface = public {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_password = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcache_username = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.region_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.service_token_roles_required = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.service_type = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.token_cache_time = 300 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.backend = dogpile.cache.null {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.backend_argument = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.backend_expiration_time = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.config_prefix = cache.oslo {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.debug_cache_backend = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.enable_retry_client = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.enable_socket_keepalive = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.expiration_time = 600 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.hashclient_retry_attempts = 2 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_dead_retry = 300 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_pool_maxsize = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_sasl_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.password = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.proxies = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.redis_db = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.redis_sentinel_service_name = mymaster {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.redis_server = localhost:6379 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.retry_attempts = 2 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.retry_delay = 0.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.socket_keepalive_count = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.socket_keepalive_idle = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.socket_keepalive_interval = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.socket_timeout = 1.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.tls_allowed_ciphers = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.tls_cafile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.tls_certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.tls_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.tls_keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cache.username = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] coordination.backend_url = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.asyncio_connection = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.asyncio_slave_connection = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.backend = sqlalchemy {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.connection = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.connection_debug = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.connection_parameters = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.connection_recycle_time = 3600 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.connection_trace = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.db_inc_retry_interval = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.db_max_retries = 20 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.db_max_retry_interval = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.db_retry_interval = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.max_overflow = 50 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.max_pool_size = 5 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.max_retries = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack sudo[76308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.mysql_wsrep_sync_wait = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.pool_timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.retry_interval = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.slave_connection = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.sqlite_synchronous = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.synchronous_reader = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] database.use_db_reconnect = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_tracing.insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.connection_string = messaging:// {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.es_doc_type = notification {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.es_scroll_size = 10000 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.es_scroll_time = 2m {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.filter_error_trace = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.hmac_keys = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.sentinel_service_name = mymaster {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.socket_timeout = 0.1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.trace_requests = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler.trace_sqlalchemy = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler_jaeger.process_tags = {} {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler_jaeger.service_name_prefix = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] profiler_otlp.service_name_prefix = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.enforce_new_defaults = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.policy_default_rule = default {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.policy_file = policy.yaml {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_policy.remote_timeout = 60.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.group = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.helper_command = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] privsep_osbrick.user = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.group = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.helper_command = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] cinder_sys_admin.user = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.auth_section = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.auth_type = password {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.cafile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.collect_timing = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.send_service_user_token = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.split_loggers = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] service_user.timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.auth_section = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.auth_type = password {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.collect_timing = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.region_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.split_loggers = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] glance.timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.backend_availability_zone = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.chap_password = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.chap_username = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.disk_geometry = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.driver_client_cert = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.driver_client_cert_key = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.driver_data_namespace = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.driver_use_ssl = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.enable_unsupported_driver = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.extra_capabilities = {} {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.filter_function = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.goodness_function = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.iscsi_target_flags = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.iscsi_write_cache = on {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.iser_helper = tgtadm {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.iser_port = 3260 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.lvm_mirrors = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.lvm_share_target = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.lvm_type = auto {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.num_shell_tries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.nvmet_port_id = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.replication_device = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.report_discard_supported = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.reserved_percentage = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.scst_target_driver = iscsi {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.scst_target_iqn_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.storage_protocol = iSCSI {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.target_helper = tgtadm {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.target_port = 3260 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.target_protocol = iscsi {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.trace_flags = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.unique_fqdn_network = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.use_chap_auth = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_backend_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_clear = zero {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_clear_ionice = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_clear_size = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volume_group = cinder-volumes {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_reports.file_event_handler = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_reports.log_dir = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.backend_availability_zone = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.backend_host = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.chap_password = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.chap_username = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.chiscsi_conf = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.disk_geometry = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.driver_client_cert = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.driver_data_namespace = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.driver_use_ssl = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.extra_capabilities = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.filter_function = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.goodness_function = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.iser_helper = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.iser_ip_address = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.iser_port = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.iser_target_prefix = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.lvm_conf_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.lvm_mirrors = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.lvm_share_target = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.lvm_type = auto {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.num_shell_tries = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.nvmet_port_id = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.replication_device = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.report_discard_supported = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.reserved_percentage = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.scst_target_driver = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.storage_protocol = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.target_helper = lioadm {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.target_ip_address = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.target_port = 3260 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.target_protocol = iscsi {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.trace_flags = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.use_chap_auth = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_clear = zero {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_clear_size = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] lvmdriver-1.volumes_dir = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.ssl_version = {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_notifications.driver = [] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_notifications.retry = -1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] oslo_messaging_notifications.transport_url = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] key_manager.fixed_key = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.barbican_api_version = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.barbican_endpoint = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.barbican_endpoint_type = public {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.barbican_region_name = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.cafile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.collect_timing = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.number_of_retries = 60 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.retry_delay = 1 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.send_service_user_token = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.split_loggers = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.verify_ssl = True {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican.verify_ssl_path = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.auth_section = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.auth_type = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.cafile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.certfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.collect_timing = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.insecure = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.keyfile = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.split_loggers = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] barbican_service_user.timeout = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.approle_role_id = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.approle_secret_id = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.auth_method = approle {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.auth_path = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.kv_mountpoint = secret {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.kv_path = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.kv_version = 2 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.namespace = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.root_token_id = **** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.ssl_ca_crt_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.timeout = 60.0 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.token_file = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.token_role = None {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.use_ssl = False {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:15:34 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] ******************************************************************************** {{(pid=76143) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 11:15:34 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.358s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:34 devstack sudo[76312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:34 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:34 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.304s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:15:34 devstack cinder-volume[76304]: INFO cinder.brick.local_dev.lvm [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:34 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:34 devstack sudo[76317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:15:34 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:35 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG cinder.brick.local_dev.lvm [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76304) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:35 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:35 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:35 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:35 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:35 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:35 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:36 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:36 devstack sudo[76749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 11:15:36 devstack sudo[76749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:36 devstack sudo[76749]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.257s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:36 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:15:36 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:36 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.376s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:36 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:15:36 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:36 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:36 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:36 devstack sudo[76929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:36 devstack sudo[76929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:37 devstack sudo[76929]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:37 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:37 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:37 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:37 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:37 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:37 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:37 devstack cinder-volume[76304]: INFO cinder.volume.drivers.lvm [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:37 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:37 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:37 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:38 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:38 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:15:38 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:38 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:38 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:38 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:38 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:38 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:38 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:38 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:39 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:39 devstack sudo[77126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:39 devstack sudo[77126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:39 devstack sudo[77126]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:39 devstack cinder-volume[76304]: INFO cinder.volume.driver [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG cinder.volume.driver [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76304) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_db.sqlalchemy.engines [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writer thread running {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG cinder.db.api [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Building query based on filter {{(pid=76304) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG cinder.image.image_utils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76304) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 11:15:39 devstack cinder-volume[76304]: INFO cinder.keymgr.migration [None req-57564d47-a057-4138-a3f3-d0ee5f256b14 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:39 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:15:39 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:39 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:39 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:39 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:39 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:39 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:40 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:40 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:40 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:40 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:40 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:40 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG cinder.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Notifying Schedulers of capabilities ... {{(pid=76304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:15:40 devstack cinder-volume[76304]: INFO cinder.volume.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Driver initialization completed successfully. Sep 01 11:15:40 devstack cinder-volume[76304]: INFO cinder.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Initiating service 2 cleanup Sep 01 11:15:40 devstack cinder-volume[76304]: INFO cinder.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Service 2 cleanup completed. Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG cinder.service [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Creating RPC server for service cinder-volume {{(pid=76304) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG cinder.service [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76304) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 11:15:40 devstack cinder-volume[76304]: INFO cinder.volume.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:40 devstack sudo[77145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:15:40 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:40 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:40 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:40 devstack sudo[77149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:40 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:41 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:41 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:41 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:41 devstack sudo[77153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:15:41 devstack sudo[77153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:41 devstack sudo[77153]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:41 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:41 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:15:41 devstack sudo[77156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:15:41 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:15:41 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root Sep 01 11:15:41 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:15:41 devstack cinder-volume[76304]: INFO cinder.volume.manager [None req-b9e2a96e-4b3a-42c6-a0ee-283e272b53c5 None None] Driver post RPC initialization completed successfully. Sep 01 11:15:43 devstack cinder-volume[76143]: DEBUG dbcounter [-] [76143] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76143) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:15:51 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:15:51 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:15:56 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager._thread_info {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:15:56 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread count: 6 {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:15:56 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread info: [<_MainThread(MainThread, started 137031911706752)>, , , , , ] {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:16:56 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:16:56 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:16:56 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:16:56 devstack sudo[79513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:16:56 devstack sudo[79513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:16:57 devstack sudo[79513]: pam_unix(sudo:session): session closed for user root Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:16:57 devstack sudo[79516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:16:57 devstack sudo[79516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:16:57 devstack sudo[79516]: pam_unix(sudo:session): session closed for user root Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:16:57 devstack sudo[79519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:16:57 devstack sudo[79519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:16:57 devstack sudo[79519]: pam_unix(sudo:session): session closed for user root Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:16:57 devstack sudo[79538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:16:57 devstack sudo[79538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:16:57 devstack sudo[79538]: pam_unix(sudo:session): session closed for user root Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG cinder.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Notifying Schedulers of capabilities ... {{(pid=76304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager._thread_info {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread count: 6 {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:16:57 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread info: [<_MainThread(MainThread, started 137031911706752)>, , , , , ] {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:17:51 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writing DB stats cinder:SELECT=1 {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:17:51 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writing DB stats cinder:UPDATE=1 {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:17:56 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:17:56 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:17:56 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:17:56 devstack sudo[82705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:17:56 devstack sudo[82705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:17:57 devstack sudo[82705]: pam_unix(sudo:session): session closed for user root Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:17:57 devstack sudo[82708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:17:57 devstack sudo[82708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:17:57 devstack sudo[82708]: pam_unix(sudo:session): session closed for user root Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:17:57 devstack sudo[82728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:17:57 devstack sudo[82728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:17:57 devstack sudo[82728]: pam_unix(sudo:session): session closed for user root Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:17:57 devstack sudo[82731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:17:57 devstack sudo[82731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:17:57 devstack sudo[82731]: pam_unix(sudo:session): session closed for user root Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG cinder.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Notifying Schedulers of capabilities ... {{(pid=76304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager._thread_info {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread count: 6 {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:17:57 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread info: [<_MainThread(MainThread, started 137031911706752)>, , , , , ] {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:18:56 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:18:56 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:18:56 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:18:56 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:18:56 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:18:57 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:18:57 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:18:57 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:18:57 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:18:57 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:18:57 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:18:57 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:18:57 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:18:57 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:18:57 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG cinder.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Notifying Schedulers of capabilities ... {{(pid=76304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager._thread_info {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread count: 6 {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:18:57 devstack cinder-volume[76304]: DEBUG cinder.volume.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] thread info: [<_MainThread(MainThread, started 137031911706752)>, , , , , ] {{(pid=76304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:19:51 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writing DB stats cinder:SELECT=1 {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:19:51 devstack cinder-volume[76304]: DEBUG dbcounter [-] [76304] Writing DB stats cinder:UPDATE=1 {{(pid=76304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:19:56 devstack cinder-volume[76304]: DEBUG oslo_service.periodic_task [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:19:56 devstack cinder-volume[76304]: DEBUG cinder.volume.drivers.lvm [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Updating volume stats {{(pid=76304) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Sep 01 11:19:56 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:19:56 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:19:56 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:19:57 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:19:57 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:19:57 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:19:57 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:19:57 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:19:57 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:19:57 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:19:57 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:19:57 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:19:57 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG oslo_concurrency.processutils [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:19:57 devstack cinder-volume[76304]: DEBUG cinder.manager [None req-c3ddf613-e437-489d-8983-663f62d60c05 None None] Notifying Schedulers of capabilities ... {{(pid=76304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:20:06 devstack cinder-volume[76143]: INFO oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Caught SIGTERM, stopping children Sep 01 11:20:06 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Acquiring lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:20:06 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Acquired lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:20:06 devstack cinder-volume[76143]: DEBUG oslo_concurrency.lockutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Releasing lock "singleton_lock" {{(pid=76143) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:20:06 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Stop services. {{(pid=76143) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 11:20:06 devstack cinder-volume[76143]: DEBUG oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Killing children. {{(pid=76143) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 11:20:06 devstack cinder-volume[76143]: INFO oslo_service.backend._eventlet.service [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Waiting on 1 children to exit Sep 01 11:20:11 devstack cinder-volume[76304]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 01 11:20:11 devstack cinder-volume[86298]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 11:20:11 devstack cinder-volume[86298]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 11:20:11 devstack cinder-volume[86298]: we strongly recommend against using it for new projects. Sep 01 11:20:11 devstack cinder-volume[86298]: If you are already using Eventlet, we recommend migrating to a different Sep 01 11:20:11 devstack cinder-volume[86298]: framework. For more detail see Sep 01 11:20:11 devstack cinder-volume[86298]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 11:20:11 devstack cinder-volume[86298]: import eventlet # noqa Sep 01 11:20:13 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:20:13 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:20:13 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:20:14 devstack cinder-volume[86298]: INFO dbcounter [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Registered counter for database cinder Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_db.sqlalchemy.engines [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG dbcounter [-] [86298] Writer thread running {{(pid=86298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:20:14 devstack cinder-volume[86298]: INFO cinder.rpc [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 11:20:14 devstack cinder-volume[86298]: INFO cinder.rpc [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_db.sqlalchemy.engines [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:14 devstack cinder-volume[86298]: INFO cinder.volume.manager [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Determined volume DB was empty at startup. Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG cinder.volume.manager [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86298) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 11:20:14 devstack cinder-volume[86298]: INFO cinder.volume.manager [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 11:20:14 devstack cinder-volume[86298]: WARNING stevedore.named [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 11:20:14 devstack cinder-volume[86298]: WARNING castellan.key_manager [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:20:14 devstack cinder-volume[86298]: WARNING cinder.keymgr.conf_key_mgr [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:20:14 devstack cinder-volume[86298]: INFO cinder.volume.manager [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_db.sqlalchemy.engines [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:14 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Starting 1 workers Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Started child 86516 {{(pid=86298) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Full set of CONF: {{(pid=86298) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] ******************************************************************************** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Configuration options gathered from: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] ================================================================================ {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 11:20:14 devstack cinder-volume[86516]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] allow_availability_zone_fallback = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] allow_compression_on_image_upload = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] allowed_direct_url_schemes = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] api_rate_limit = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] auth_strategy = keystone {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_host = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_stats_polling_interval = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backup_api_class = cinder.backup.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backup_name_template = backup-%s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backup_use_same_host = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backup_use_temp_snapshot = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] chap_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] chap_username = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_internal_tenant_project_id = f8778c66e9ad43f28dcc134695a35837 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_internal_tenant_user_id = a8cd54c2df804097b8cc4bdc2e99f02a {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cluster = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] compression_format = gzip {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] compute_api_class = cinder.compute.nova.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] config_dir = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] config_source = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] control_exchange = openstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] debug = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] default_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] default_group_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] default_volume_type = QuobyteHD {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] disk_geometry = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] driver_client_cert = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] driver_client_cert_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] driver_data_namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] driver_ssl_cert_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] driver_ssl_cert_verify = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] driver_use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] enable_new_services = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] enable_unsupported_driver = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] enabled_backends = ['QuobyteHD'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] enforce_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] filter_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_api_insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_api_ssl_compression = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_ca_certificates_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_catalog_info = image:glance:publicURL {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_num_retries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance_request_timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] goodness_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] graceful_shutdown_timeout = 5 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] group_api_class = cinder.group.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] host = devstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_compress_on_upload = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_conversion_address_space_limit = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_conversion_cpu_limit = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_conversion_disable = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_upload_use_cinder_backend = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_upload_use_internal_tenant = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_volume_cache_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_volume_cache_max_count = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86516]: INFO cinder.volume.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Starting volume driver QuobyteDriver (1.1.14) Sep 01 11:20:14 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.remotefs [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86516) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] image_volume_cache_max_size_gb = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] init_host_max_objects_retrieval = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] instance_format = [instance: %(uuid)s] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] iscsi_target_flags = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] iscsi_write_cache = on {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] iser_helper = tgtadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] iser_ip_address = 192.168.122.48 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] iser_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_color = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_config_append = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_dir = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_options = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_rotate_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_rotate_interval_type = days {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] log_rotation_type = none {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] max_age = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] max_logfile_count = 30 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] max_logfile_size_mb = 200 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] max_over_subscription_ratio = 20.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] message_reap_interval = 86400 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] message_ttl = 2592000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] migration_create_volume_timeout_secs = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] monkey_patch = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] monkey_patch_modules = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] my_ip = 192.168.122.48 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] no_snapshot_gb_quota = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] num_iser_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] num_shell_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] num_volume_device_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] nvmeof_conn_info_version = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] nvmet_ns_id = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] nvmet_port_id = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_max_limit = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_volume_ext_list = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_volume_listen_port = 8776 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_volume_use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] osapi_volume_workers = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] per_volume_size_limit = -1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] periodic_fuzzy_delay = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] periodic_interval = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] public_endpoint = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] publish_errors = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_backup_gigabytes = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_backups = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_gigabytes = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_groups = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_snapshots = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] quota_volumes = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] rate_limit_burst = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] rate_limit_except_level = CRITICAL {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] rate_limit_interval = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] reinit_driver_count = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] replication_device = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] report_discard_supported = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] report_interval = 120 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] reservation_clean_interval = 86400 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] reservation_expire = 86400 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] reserved_image_namespaces = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] reserved_percentage = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] rpc_response_timeout = 120 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] run_external_periodic_tasks = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] scst_target_driver = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] scst_target_iqn_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_down_time = 720 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] shell_completion = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] snapshot_name_template = snapshot-%s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] state_path = /opt/stack/data/cinder {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] storage_availability_zone = nova {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] storage_protocol = iSCSI {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] syslog_log_facility = LOG_USER {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] target_helper = lioadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] target_ip_address = 192.168.122.48 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] target_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] target_protocol = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] target_secondary_ip_addresses = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] trace_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] transport_url = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] until_refresh = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_chap_auth = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_default_quota_class = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_journal = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_json = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_stderr = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] use_syslog = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] verify_glance_signatures = enabled {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_api_class = cinder.volume.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_backend_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_clear = zero {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_clear_ionice = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_clear_size = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_copy_bps_limit = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_dd_blocksize = 1M {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_name_template = volume-%s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_service_inithost_offload = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volume_usage_audit_period = month {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] zoning_mode = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_concurrency.disable_process_locking = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.auth_type = password {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.auth_version = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.cache = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.include_service_catalog = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.interface = public {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcache_username = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86516) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Sep 01 11:20:15 devstack cinder-volume[86516]: WARNING cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 11:20:15 devstack cinder-volume[86516]: WARNING cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Running cmd (subprocess): mount.quobyte {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.region_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.service_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.backend = dogpile.cache.null {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.backend_argument = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.backend_expiration_time = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.config_prefix = cache.oslo {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.debug_cache_backend = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.enable_retry_client = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.enable_socket_keepalive = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.expiration_time = 600 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.hashclient_retry_attempts = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_dead_retry = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_pool_maxsize = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_sasl_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.proxies = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.redis_db = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.redis_server = localhost:6379 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.retry_attempts = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.retry_delay = 0.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.socket_keepalive_count = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.socket_keepalive_idle = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.socket_keepalive_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.socket_timeout = 1.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.tls_allowed_ciphers = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.tls_cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.tls_certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.tls_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.tls_keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cache.username = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] coordination.backend_url = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.asyncio_connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.asyncio_slave_connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.backend = sqlalchemy {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.connection_debug = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.connection_parameters = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.connection_recycle_time = 3600 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.connection_trace = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.db_inc_retry_interval = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.db_max_retries = 20 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.db_max_retry_interval = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.db_retry_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.max_overflow = 50 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.max_pool_size = 5 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.max_retries = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.mysql_wsrep_sync_wait = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.pool_timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.retry_interval = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.slave_connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.sqlite_synchronous = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.synchronous_reader = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] database.use_db_reconnect = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_tracing.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.connection_string = messaging:// {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.es_doc_type = notification {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.es_scroll_size = 10000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.es_scroll_time = 2m {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.filter_error_trace = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.hmac_keys = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.sentinel_service_name = mymaster {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.socket_timeout = 0.1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.trace_requests = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler.trace_sqlalchemy = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler_jaeger.process_tags = {} {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler_jaeger.service_name_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] profiler_otlp.service_name_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.enforce_new_defaults = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.policy_default_rule = default {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.policy_file = policy.yaml {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.group = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.helper_command = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] privsep_osbrick.user = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.group = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.helper_command = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] cinder_sys_admin.user = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.auth_type = password {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.send_service_user_token = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] service_user.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.auth_type = password {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.region_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] glance.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.backend_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.chap_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.chap_username = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.disk_geometry = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.driver_client_cert = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.driver_client_cert_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.driver_data_namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.driver_use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.extra_capabilities = {} {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.filter_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.goodness_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.iscsi_target_flags = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.iscsi_write_cache = on {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.iser_helper = tgtadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.iser_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_host = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_login = admin {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_mount_options = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_private_key = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_share_path = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.num_shell_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.quobyte_volume_url = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.replication_device = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.report_discard_supported = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.reserved_percentage = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.target_helper = tgtadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.target_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.target_protocol = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.trace_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.unique_fqdn_network = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.use_chap_auth = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_backend_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_clear = zero {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_clear_ionice = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_clear_size = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_reports.file_event_handler = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_reports.log_dir = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.backend_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.backend_host = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.chap_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.chap_username = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.chiscsi_conf = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.disk_geometry = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.driver_client_cert = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.driver_data_namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.driver_use_ssl = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.extra_capabilities = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.filter_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.goodness_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.iser_helper = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.iser_ip_address = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.iser_port = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.iser_target_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_host = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_login = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_mount_options = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_private_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_share_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_ssh_port = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.num_shell_tries = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.nvmet_port_id = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack quobyte-client[86517]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.replication_device = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.report_discard_supported = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.reserved_percentage = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.scst_target_driver = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.storage_protocol = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack quobyte-client[86517]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.target_helper = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.target_ip_address = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.target_port = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.target_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.target_protocol = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.trace_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.use_chap_auth = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_clear = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_clear_size = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] QuobyteHD.volumes_dir = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_notifications.driver = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_notifications.retry = -1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] key_manager.fixed_key = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.barbican_api_version = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.barbican_endpoint = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.barbican_endpoint_type = public {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.barbican_region_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.number_of_retries = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.retry_delay = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.send_service_user_token = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.verify_ssl = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican.verify_ssl_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.auth_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=86516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] barbican_service_user.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.approle_role_id = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.approle_secret_id = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: INFO cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 ... Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.auth_method = approle {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.auth_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.kv_mountpoint = secret {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.kv_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.kv_version = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.root_token_id = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.ssl_ca_crt_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.timeout = 60.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 -c /etc/quobyte/client-cinder.cfg {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.token_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.token_role = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] ******************************************************************************** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 11:20:15 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 -c /etc/quobyte/client-cinder.cfg Sep 01 11:20:15 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:15 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.364s {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:15 devstack cinder-volume[86516]: INFO cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 succeeded Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=86516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.378s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:15 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:15 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:15 devstack cinder-volume[76304]: DEBUG oslo_concurrency.lockutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Acquiring lock "singleton_lock" {{(pid=76304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:20:15 devstack cinder-volume[76304]: DEBUG oslo_concurrency.lockutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Acquired lock "singleton_lock" {{(pid=76304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:20:15 devstack cinder-volume[76304]: DEBUG oslo_concurrency.lockutils [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Releasing lock "singleton_lock" {{(pid=76304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:20:15 devstack cinder-volume[76304]: WARNING amqp [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 11:20:15 devstack cinder-volume[76304]: WARNING amqp [None req-5b0fb239-17c4-4ac7-a6b1-20b68834230a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 11:20:15 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.260s {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:15 devstack cinder-volume[86516]: INFO cinder.volume.driver [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.volume.driver [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.923038482666, 'free_capacity_gb': 1773.923038482666, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86516) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_db.sqlalchemy.engines [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86516) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG dbcounter [-] [86516] Writer thread running {{(pid=86516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.db.api [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Building query based on filter {{(pid=86516) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.image.image_utils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86516) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 11:20:15 devstack cinder-volume[86516]: INFO cinder.keymgr.migration [None req-bca2f11b-fd57-4153-9cc7-27a17e89aa60 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:15 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=86516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=86516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:16 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:16 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:16 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.291s {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG cinder.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Notifying Schedulers of capabilities ... {{(pid=86516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:20:16 devstack cinder-volume[86516]: INFO cinder.volume.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Driver initialization completed successfully. Sep 01 11:20:16 devstack cinder-volume[86516]: INFO cinder.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Initiating service 3 cleanup Sep 01 11:20:16 devstack cinder-volume[86516]: INFO cinder.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Service 3 cleanup completed. Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG cinder.service [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Creating RPC server for service cinder-volume {{(pid=86516) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG cinder.service [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86516) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 11:20:16 devstack cinder-volume[86516]: INFO cinder.volume.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=86516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=86516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:16 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:16 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:16 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:16 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.278s {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:16 devstack cinder-volume[86516]: INFO cinder.volume.manager [None req-a9cba65b-5532-430d-8d93-1e407640cf42 None None] Driver post RPC initialization completed successfully. Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=86516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG cinder.volume.drivers.quobyte [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=86516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:21 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:21 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:21 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG oslo_concurrency.processutils [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.231s {{(pid=86516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:21 devstack cinder-volume[86516]: DEBUG cinder.manager [None req-fa343639-be1c-4cd6-ae5f-f87e9c10dadf None None] Notifying Schedulers of capabilities ... {{(pid=86516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:20:21 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Caught SIGTERM, stopping children Sep 01 11:20:21 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Acquiring lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:20:21 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Acquired lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:20:21 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Releasing lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:20:21 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Stop services. {{(pid=86298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 11:20:21 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Killing children. {{(pid=86298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 11:20:21 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Waiting on 1 children to exit Sep 01 11:20:24 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Acquiring lock "singleton_lock" {{(pid=86516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:20:24 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Acquired lock "singleton_lock" {{(pid=86516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:20:24 devstack cinder-volume[86516]: DEBUG oslo_concurrency.lockutils [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Releasing lock "singleton_lock" {{(pid=86516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:20:24 devstack cinder-volume[86516]: WARNING amqp [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 11:20:24 devstack cinder-volume[86516]: WARNING amqp [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 11:20:24 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-97da78de-b807-490d-86fb-eea9fe5a310e None None] Child 86516 exited with status 0 Sep 01 11:20:25 devstack cinder-volume[86848]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 11:20:25 devstack cinder-volume[86848]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 11:20:25 devstack cinder-volume[86848]: we strongly recommend against using it for new projects. Sep 01 11:20:25 devstack cinder-volume[86848]: If you are already using Eventlet, we recommend migrating to a different Sep 01 11:20:25 devstack cinder-volume[86848]: framework. For more detail see Sep 01 11:20:25 devstack cinder-volume[86848]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 11:20:25 devstack cinder-volume[86848]: import eventlet # noqa Sep 01 11:20:28 devstack cinder-volume[86848]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:20:28 devstack cinder-volume[86848]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:20:28 devstack cinder-volume[86848]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:20:29 devstack cinder-volume[86848]: INFO dbcounter [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Registered counter for database cinder Sep 01 11:20:29 devstack cinder-volume[86848]: DEBUG oslo_db.sqlalchemy.engines [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:29 devstack cinder-volume[86848]: DEBUG dbcounter [-] [86848] Writer thread running {{(pid=86848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:20:29 devstack cinder-volume[86848]: INFO cinder.rpc [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 11:20:29 devstack cinder-volume[86848]: INFO cinder.rpc [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 11:20:29 devstack cinder-volume[86848]: DEBUG oslo_db.sqlalchemy.engines [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:30 devstack cinder-volume[86848]: INFO cinder.volume.manager [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Determined volume DB was empty at startup. Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG cinder.volume.manager [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86848) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 11:20:30 devstack cinder-volume[86848]: WARNING stevedore.named [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 11:20:30 devstack cinder-volume[86848]: WARNING castellan.key_manager [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:20:30 devstack cinder-volume[86848]: WARNING cinder.keymgr.conf_key_mgr [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:20:30 devstack cinder-volume[86848]: INFO cinder.volume.manager [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_db.sqlalchemy.engines [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:30 devstack cinder-volume[86848]: INFO oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Starting 1 workers Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Started child 87144 {{(pid=86848) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Full set of CONF: {{(pid=86848) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] ******************************************************************************** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] Configuration options gathered from: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] ================================================================================ {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] allow_availability_zone_fallback = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] allow_compression_on_image_upload = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] allowed_direct_url_schemes = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] api_rate_limit = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] auth_strategy = keystone {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_host = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_stats_polling_interval = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backup_api_class = cinder.backup.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backup_name_template = backup-%s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[87144]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backup_use_same_host = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backup_use_temp_snapshot = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] chap_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] chap_username = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_internal_tenant_project_id = f8778c66e9ad43f28dcc134695a35837 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_internal_tenant_user_id = a8cd54c2df804097b8cc4bdc2e99f02a {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cluster = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] compression_format = gzip {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] compute_api_class = cinder.compute.nova.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] config_dir = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] config_source = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] control_exchange = openstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] debug = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] default_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] default_group_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] default_volume_type = QuobyteHD {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] disk_geometry = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] driver_client_cert = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] driver_client_cert_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] driver_data_namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] driver_ssl_cert_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] driver_ssl_cert_verify = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] driver_use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] enable_new_services = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] enable_unsupported_driver = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] enabled_backends = ['QuobyteHD'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] enforce_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] filter_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_api_insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_api_ssl_compression = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_ca_certificates_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_catalog_info = image:glance:publicURL {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_num_retries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance_request_timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] goodness_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] graceful_shutdown_timeout = 5 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] group_api_class = cinder.group.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] host = devstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_compress_on_upload = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_conversion_address_space_limit = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_conversion_cpu_limit = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_conversion_disable = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_upload_use_cinder_backend = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_upload_use_internal_tenant = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_volume_cache_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_volume_cache_max_count = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] image_volume_cache_max_size_gb = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] init_host_max_objects_retrieval = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] instance_format = [instance: %(uuid)s] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] iscsi_target_flags = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] iscsi_write_cache = on {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] iser_helper = tgtadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] iser_ip_address = 192.168.122.48 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] iser_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_color = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_config_append = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_dir = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_options = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_rotate_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_rotate_interval_type = days {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] log_rotation_type = none {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] max_age = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] max_logfile_count = 30 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] max_logfile_size_mb = 200 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] max_over_subscription_ratio = 20.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] message_reap_interval = 86400 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] message_ttl = 2592000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] migration_create_volume_timeout_secs = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] monkey_patch = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] monkey_patch_modules = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] my_ip = 192.168.122.48 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] no_snapshot_gb_quota = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] num_iser_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] num_shell_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] num_volume_device_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] nvmeof_conn_info_version = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] nvmet_ns_id = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] nvmet_port_id = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_max_limit = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_volume_ext_list = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_volume_listen = 0.0.0.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_volume_listen_port = 8776 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_volume_use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] osapi_volume_workers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] per_volume_size_limit = -1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] periodic_fuzzy_delay = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] periodic_interval = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] project_id_regex = [0-9a-f\-]+ {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] public_endpoint = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] publish_errors = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_backup_gigabytes = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_backups = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_gigabytes = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_groups = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_snapshots = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] quota_volumes = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] rate_limit_burst = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] rate_limit_except_level = CRITICAL {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] rate_limit_interval = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] reinit_driver_count = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] replication_device = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] report_discard_supported = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] report_interval = 120 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] reservation_clean_interval = 86400 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] reservation_expire = 86400 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] reserved_image_namespaces = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] reserved_percentage = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] rpc_response_timeout = 120 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] run_external_periodic_tasks = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] scst_target_driver = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] scst_target_iqn_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_down_time = 720 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] shell_completion = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] snapshot_name_template = snapshot-%s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] state_path = /opt/stack/data/cinder {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] storage_availability_zone = nova {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] storage_protocol = iSCSI {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] syslog_log_facility = LOG_USER {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] target_helper = lioadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] target_ip_address = 192.168.122.48 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] target_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] target_protocol = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] target_secondary_ip_addresses = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] trace_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] transfer_api_class = cinder.transfer.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] transport_url = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] until_refresh = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_chap_auth = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_default_quota_class = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_journal = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_json = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_stderr = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] use_syslog = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] verify_glance_signatures = enabled {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_api_class = cinder.volume.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_backend_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_clear = zero {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_clear_ionice = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_clear_size = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_copy_bps_limit = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_dd_blocksize = 1M {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_name_template = volume-%s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_service_inithost_offload = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volume_usage_audit_period = month {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] zoning_mode = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_concurrency.disable_process_locking = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.auth_type = password {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.auth_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.cache = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.delay_auth_decision = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.http_connect_timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.include_service_catalog = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.interface = public {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Starting volume driver QuobyteDriver (1.1.14) Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87144) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcache_username = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.region_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.service_token_roles_required = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.service_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.token_cache_time = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.backend = dogpile.cache.null {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.backend_argument = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.backend_expiration_time = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.config_prefix = cache.oslo {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.debug_cache_backend = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.enable_retry_client = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.enable_socket_keepalive = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.expiration_time = 600 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.hashclient_retry_attempts = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_dead_retry = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_pool_maxsize = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_sasl_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.proxies = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.redis_db = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.redis_sentinel_service_name = mymaster {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.redis_server = localhost:6379 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.retry_attempts = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.retry_delay = 0.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.socket_keepalive_count = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.socket_keepalive_idle = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.socket_keepalive_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.socket_timeout = 1.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.tls_allowed_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.tls_cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.tls_certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.tls_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.tls_keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cache.username = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] coordination.backend_url = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.asyncio_connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.asyncio_slave_connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.backend = sqlalchemy {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.connection_debug = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.connection_parameters = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.connection_recycle_time = 3600 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.connection_trace = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.db_inc_retry_interval = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.db_max_retries = 20 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.db_max_retry_interval = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.db_retry_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.max_overflow = 50 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.max_pool_size = 5 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.max_retries = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.mysql_wsrep_sync_wait = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.pool_timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.retry_interval = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.slave_connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.sqlite_synchronous = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.synchronous_reader = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] database.use_db_reconnect = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_tracing.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.connection_string = messaging:// {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.es_doc_type = notification {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.es_scroll_size = 10000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.es_scroll_time = 2m {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.filter_error_trace = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.hmac_keys = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.sentinel_service_name = mymaster {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.socket_timeout = 0.1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.trace_requests = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler.trace_sqlalchemy = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler_jaeger.process_tags = {} {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler_jaeger.service_name_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] profiler_otlp.service_name_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.enforce_new_defaults = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.policy_default_rule = default {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.policy_file = policy.yaml {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_policy.remote_timeout = 60.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.group = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.helper_command = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] privsep_osbrick.user = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.group = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.helper_command = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] cinder_sys_admin.user = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.auth_type = password {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.send_service_user_token = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] service_user.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.auth_type = password {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.region_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] glance.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.backend_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.chap_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.chap_username = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.disk_geometry = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.driver_client_cert = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.driver_client_cert_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.driver_data_namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.driver_use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.enable_unsupported_driver = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.extra_capabilities = {} {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.filter_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.goodness_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.iscsi_target_flags = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.iscsi_write_cache = on {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.iser_helper = tgtadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.iser_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_host = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_login = admin {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_mount_options = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_private_key = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_share_path = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_ssh_port = 22 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.num_shell_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.nvmet_port_id = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_client_cfg = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.quobyte_volume_url = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.replication_device = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.report_discard_supported = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.reserved_percentage = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.scst_target_driver = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.scst_target_iqn_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.storage_protocol = iSCSI {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.target_helper = tgtadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.target_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.target_protocol = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.trace_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.unique_fqdn_network = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.use_chap_auth = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_backend_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_clear = zero {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_clear_ionice = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_clear_size = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_reports.file_event_handler = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_reports.log_dir = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.backend_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.backend_host = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.chap_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.chap_username = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.chiscsi_conf = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.disk_geometry = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.driver_client_cert = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.driver_client_cert_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.driver_data_namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.driver_use_ssl = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.extra_capabilities = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.filter_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.goodness_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.iscsi_target_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.iscsi_write_cache = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.iser_helper = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.iser_ip_address = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.iser_port = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.iser_target_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_host = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_login = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_mount_options = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_private_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_share_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_ssh_port = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.num_shell_tries = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nvmet_ns_id = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.nvmet_port_id = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.replication_device = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.report_discard_supported = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.reserved_percentage = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.scst_target_driver = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.storage_protocol = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.target_helper = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.target_ip_address = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.target_port = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.target_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.target_protocol = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.trace_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.unique_fqdn_network = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.use_chap_auth = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_clear = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_clear_ionice = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_clear_size = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] QuobyteHD.volumes_dir = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.ssl_version = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_notifications.driver = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_notifications.retry = -1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] oslo_messaging_notifications.transport_url = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] key_manager.fixed_key = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.barbican_api_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.barbican_endpoint = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.barbican_endpoint_type = public {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.barbican_region_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.number_of_retries = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.retry_delay = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.send_service_user_token = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.verify_ssl = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican.verify_ssl_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.auth_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87144) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Sep 01 11:20:30 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 11:20:30 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Running cmd (subprocess): mount.quobyte {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] barbican_service_user.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.approle_role_id = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.approle_secret_id = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.auth_method = approle {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.auth_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.kv_mountpoint = secret {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.kv_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.kv_version = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.root_token_id = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.ssl_ca_crt_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.timeout = 60.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.token_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.token_role = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:20:30 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-c1259efb-e069-489e-b4f9-46910c5230ae None None] ******************************************************************************** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 11:20:30 devstack quobyte-client[87153]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 11:20:30 devstack quobyte-client[87153]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:30 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:30 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:30 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:30 devstack cinder-volume[87144]: INFO cinder.volume.driver [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.driver [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.923038482666, 'free_capacity_gb': 1773.923038482666, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87144) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_db.sqlalchemy.engines [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writer thread running {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.db.api [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Building query based on filter {{(pid=87144) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87144) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:30 devstack cinder-volume[87144]: INFO cinder.keymgr.migration [None req-234c93b2-279b-4b5c-8564-f1742b280941 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 11:20:30 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:30 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:31 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.231s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:20:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Driver initialization completed successfully. Sep 01 11:20:31 devstack cinder-volume[87144]: INFO cinder.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Initiating service 3 cleanup Sep 01 11:20:31 devstack cinder-volume[87144]: INFO cinder.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Service 3 cleanup completed. Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG cinder.service [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Creating RPC server for service cinder-volume {{(pid=87144) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG cinder.service [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87144) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 11:20:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:20:31 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:20:31 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:20:31 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Sep 01 11:20:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:20:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-79089f10-db29-4a67-baa5-b0e21ee24690 None None] Driver post RPC initialization completed successfully. Sep 01 11:20:40 devstack cinder-volume[86848]: DEBUG dbcounter [-] [86848] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:20:41 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:20:41 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:21:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:21:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 6 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:21:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Flow 'volume_create_manager' (e330a133-02cb-4636-88f7-4303a35296f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5309e41a-f5eb-4f17-9c79-ed0636029e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5309e41a-f5eb-4f17-9c79-ed0636029e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1968634768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8c359c-8de9-4e41-9f92-3f99c89ada29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277cb6523c745398e70d02f9a09ec4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:21:30Z,use_quota=True,user_id='f687b8bfade14841940f1df40d9951cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9cc631-b889-4a11-aba0-592b0748e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9cc631-b889-4a11-aba0-592b0748e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d791537c-f70d-46ec-9a86-1e9dfbff05d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d791537c-f70d-46ec-9a86-1e9dfbff05d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8c359c-8de9-4e41-9f92-3f99c89ada29', 'volume_name': 'volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0b227-1a62-441f-826a-54757f0c92d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0b227-1a62-441f-826a-54757f0c92d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b7d37d-1238-4668-8dbb-27a8c3aff2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Volume 0e8c359c-8de9-4e41-9f92-3f99c89ada29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29', 'volume_size': 1} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1968634768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8c359c-8de9-4e41-9f92-3f99c89ada29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277cb6523c745398e70d02f9a09ec4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:21:30Z,use_quota=True,user_id='f687b8bfade14841940f1df40d9951cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Creating volume 0e8c359c-8de9-4e41-9f92-3f99c89ada29 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:21:30 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:21:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:30 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 1073741824 Sep 01 11:21:30 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:31 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 1073741824" returned: 0 in 1.255s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:32 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 Sep 01 11:21:32 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:32 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29" returned: 0 in 0.617s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b7d37d-1238-4668-8dbb-27a8c3aff2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843418a1-092f-49ff-b81f-2c03dd8b57a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Volume volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 (0e8c359c-8de9-4e41-9f92-3f99c89ada29): created successfully Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843418a1-092f-49ff-b81f-2c03dd8b57a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Flow 'volume_create_manager' (e330a133-02cb-4636-88f7-4303a35296f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:21:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bf18f611-2e83-4328-a338-18e0554c5d7e tempest-TaggedAttachmentsTest-1583693653 None] Created volume successfully. Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Flow 'volume_create_manager' (b7af1678-8d74-4902-afa7-1ee69b778d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa80cf65-662c-4d49-be77-40a595aaf82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa80cf65-662c-4d49-be77-40a595aaf82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2107875930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dc2b09-ddfb-444a-a1c4-384f4b1cfade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e58e2738094dfca9a3e42cea5c78c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:21:35Z,use_quota=True,user_id='cee2c5d5f01d4da58495f8ce4cd8a8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcff5016-4415-43e2-ab07-5b4846b09263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcff5016-4415-43e2-ab07-5b4846b09263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d688a9-607d-422d-836a-f4c1298fbf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d688a9-607d-422d-836a-f4c1298fbf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47dc2b09-ddfb-444a-a1c4-384f4b1cfade', 'volume_name': 'volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab60dde5-864f-4367-b354-8a2e74a0b19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab60dde5-864f-4367-b354-8a2e74a0b19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b048fa8-f671-4cba-bf6e-be192f165560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Volume 47dc2b09-ddfb-444a-a1c4-384f4b1cfade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade', 'volume_size': 1} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2107875930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dc2b09-ddfb-444a-a1c4-384f4b1cfade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e58e2738094dfca9a3e42cea5c78c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:21:35Z,use_quota=True,user_id='cee2c5d5f01d4da58495f8ce4cd8a8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Creating volume 47dc2b09-ddfb-444a-a1c4-384f4b1cfade {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:21:35 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:21:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:35 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade 1073741824 Sep 01 11:21:35 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:36 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade 1073741824" returned: 0 in 1.265s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:36 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade Sep 01 11:21:36 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:37 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" returned: 0 in 0.599s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b048fa8-f671-4cba-bf6e-be192f165560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41a2a92-8d23-48a6-93f5-e4d1e7279f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:21:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Volume volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade (47dc2b09-ddfb-444a-a1c4-384f4b1cfade): created successfully Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41a2a92-8d23-48a6-93f5-e4d1e7279f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:21:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Flow 'volume_create_manager' (b7af1678-8d74-4902-afa7-1ee69b778d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:21:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-556ba0b5-00d3-4383-9cab-328ee9dbd332 tempest-DeleteServersTestJSON-678078572 None] Created volume successfully. Sep 01 11:21:43 devstack cinder-volume[87144]: WARNING py.warnings [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 01 11:21:43 devstack cinder-volume[87144]: .first() Sep 01 11:21:43 devstack cinder-volume[87144]: Sep 01 11:21:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:21:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:21:44 devstack cinder-volume[87144]: INFO oslo.privsep.daemon [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1sppkwcm/privsep.sock'] Sep 01 11:21:44 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1sppkwcm/privsep.sock Sep 01 11:21:44 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 11:21:45 devstack cinder-volume[87144]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 11:21:46 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:46 devstack cinder-volume[87144]: INFO oslo.privsep.daemon [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Spawned new privsep daemon via rootwrap Sep 01 11:21:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Accepted privsep connection to /tmp/tmp1sppkwcm/privsep.sock {{(pid=87144) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 11:21:46 devstack cinder-volume[87144]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 11:21:46 devstack cinder-volume[87144]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 11:21:46 devstack cinder-volume[87144]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 11:21:46 devstack cinder-volume[87144]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88216 Sep 01 11:21:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08feb4dd-32a8-430b-a81f-ae373103c355]: (2,) {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:21:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9af36e-7111-46f4-8929-02766967f0c0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:21:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:46 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade Sep 01 11:21:46 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:47 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" returned: 0 in 0.928s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.205s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:21:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1233c3d-6341-44ad-93e2-2f275a5e4ada', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:21:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-7c9429dc-5496-4568-a5a4-d952e5d0c34c req-c1a2d3f9-e220-418b-8215-c6f08aca2321 tempest-DeleteServersTestJSON-678078572 None] attachment_update completed successfully. Sep 01 11:21:52 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-55bdb0fc-5558-4a83-bc01-3c72c909e3db req-03917902-04f1-48d0-b5e6-9ccdbaba7e3a tempest-DeleteServersTestJSON-678078572 None] Terminate volume connection completed successfully. Sep 01 11:21:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-55bdb0fc-5558-4a83-bc01-3c72c909e3db req-03917902-04f1-48d0-b5e6-9ccdbaba7e3a tempest-DeleteServersTestJSON-678078572 None] Deleting attachment f1233c3d-6341-44ad-93e2-2f275a5e4ada. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:21:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Acquiring lock "cinder-47dc2b09-ddfb-444a-a1c4-384f4b1cfade-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:21:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Lock "cinder-47dc2b09-ddfb-444a-a1c4-384f4b1cfade-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:21:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Acquiring lock "cinder-quobyte-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:21:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Lock "cinder-quobyte-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:21:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24896a0-f6cc-42e9-a4e9-e60dccd5d007]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:21:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:54 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade Sep 01 11:21:54 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:55 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" returned: 0 in 0.563s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:55 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade Sep 01 11:21:55 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:55 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" returned: 0 in 0.421s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Lock "cinder-quobyte-47dc2b09-ddfb-444a-a1c4-384f4b1cfade" released by "delete_volume" :: held 1.067s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:21:55 devstack cinder-volume[87144]: WARNING cinder.quota [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:21:55 devstack cinder-volume[87144]: WARNING cinder.quota [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Created reservations ['42587e4d-e856-4d79-a77e-e84e8ddcf2fe', '06aa56c9-eebf-4264-b534-cd8567263cb6', 'aadf6385-74f9-47a5-9550-142d9930e440', '3086702a-c5f1-4dbf-8bb0-babc6aefb28d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:21:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:21:56 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:21:56 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:21:56 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Sep 01 11:21:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.394s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:21:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:21:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Deleted volume successfully. Sep 01 11:21:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bf9e5df4-1f09-4e44-b27b-bfac81b766f0 tempest-DeleteServersTestJSON-678078572 None] Lock "cinder-47dc2b09-ddfb-444a-a1c4-384f4b1cfade-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Flow 'volume_create_manager' (cf53f7fa-b606-4185-87e9-9a454b3c8c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468a4731-0f64-4f7e-a05b-310f3c07f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468a4731-0f64-4f7e-a05b-310f3c07f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-894272404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c27c4f-142a-43a5-a9af-e78b9939eb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d277a0645bb4ba7a48bd3911b9e3dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:22:01Z,use_quota=True,user_id='d8cad01fadda4bffb35fcd792bd5cd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a807be73-e28e-4e41-a802-7bbd1a2baccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a807be73-e28e-4e41-a802-7bbd1a2baccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a1c79f-368b-47be-910c-994f6ee4b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a1c79f-368b-47be-910c-994f6ee4b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c27c4f-142a-43a5-a9af-e78b9939eb75', 'volume_name': 'volume-86c27c4f-142a-43a5-a9af-e78b9939eb75', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15d0f74-9e81-4e6f-9c93-f77c28381c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15d0f74-9e81-4e6f-9c93-f77c28381c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb97b5d-fc93-4824-8501-89649d9bcf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Volume 86c27c4f-142a-43a5-a9af-e78b9939eb75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c27c4f-142a-43a5-a9af-e78b9939eb75', 'volume_size': 1} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-894272404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c27c4f-142a-43a5-a9af-e78b9939eb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d277a0645bb4ba7a48bd3911b9e3dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:22:01Z,use_quota=True,user_id='d8cad01fadda4bffb35fcd792bd5cd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Creating volume 86c27c4f-142a-43a5-a9af-e78b9939eb75 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:22:01 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:22:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:01 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 1073741824 Sep 01 11:22:01 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:02 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 1073741824" returned: 0 in 0.950s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:02 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 Sep 01 11:22:02 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:02 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75" returned: 0 in 0.412s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb97b5d-fc93-4824-8501-89649d9bcf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c27c4f-142a-43a5-a9af-e78b9939eb75', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d669c3e4-724e-4cb6-a14e-72d0b5534181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:02 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Volume volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 (86c27c4f-142a-43a5-a9af-e78b9939eb75): created successfully Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d669c3e4-724e-4cb6-a14e-72d0b5534181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Flow 'volume_create_manager' (cf53f7fa-b606-4185-87e9-9a454b3c8c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:22:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-552635fa-f124-40f1-97a0-87224bfa413f tempest-AttachVolumeTestJSON-439105632 None] Created volume successfully. Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:04 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:22:04 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaadd84-111c-46ca-bf0f-5bc5041a39e9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:22:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:04 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 Sep 01 11:22:04 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:05 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.533s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 8 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:22:05 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.511s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-86c27c4f-142a-43a5-a9af-e78b9939eb75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f652d5e-9af5-41b0-87f8-c00f3928620e', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:22:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-32b6d4d5-a5fb-4e7d-91ec-f97cb267ee99 req-46326f27-c8e3-4d24-a739-66db3822eccb tempest-AttachVolumeTestJSON-439105632 None] attachment_update completed successfully. Sep 01 11:22:15 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=18,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:22:15 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:22:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:32 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[496c95b3-d415-48dd-b275-925cffdd916c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:22:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:32 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 Sep 01 11:22:32 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:33 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29" returned: 0 in 0.757s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2dfe5729-39fc-42cb-be42-aaf767616cae', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:22:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-fd3486db-39ed-4eb4-a369-2a80bad8e21d req-0c1c9da4-46ef-4379-b97e-afc08b3564bc tempest-TaggedAttachmentsTest-1583693653 None] attachment_update completed successfully. Sep 01 11:22:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-0d1da39a-0dc2-4978-88a2-8c3255a87e63 req-02a52740-b4ab-40ec-9759-4dff1a589f6d tempest-TaggedAttachmentsTest-1583693653 None] Terminate volume connection completed successfully. Sep 01 11:22:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-0d1da39a-0dc2-4978-88a2-8c3255a87e63 req-02a52740-b4ab-40ec-9759-4dff1a589f6d tempest-TaggedAttachmentsTest-1583693653 None] Deleting attachment 2dfe5729-39fc-42cb-be42-aaf767616cae. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:22:48 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:22:48 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:22:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-e0467174-6ea8-4195-8f69-9238688ad2e1 req-b7655c7f-db88-4b36-8892-96b987106640 tempest-AttachVolumeTestJSON-439105632 None] Terminate volume connection completed successfully. Sep 01 11:22:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-e0467174-6ea8-4195-8f69-9238688ad2e1 req-b7655c7f-db88-4b36-8892-96b987106640 tempest-AttachVolumeTestJSON-439105632 None] Deleting attachment 7f652d5e-9af5-41b0-87f8-c00f3928620e. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Flow 'volume_create_manager' (e3456084-5e76-40e1-81ef-8fcbb22a7719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8284d4-5f57-4bc5-8ca2-e6fb4f6c96e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8284d4-5f57-4bc5-8ca2-e6fb4f6c96e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-842101825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6350ab82-3973-4b8e-b62c-f8b2c89e7d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5054e7ef9bc40e6b217e8b613f217fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:22:57Z,use_quota=True,user_id='018a3db175594a1a85b259a9834813d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a981259d-d365-47c2-9d8c-764519067869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a981259d-d365-47c2-9d8c-764519067869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4f3be7-4bf9-4d81-a3af-309cea4c6206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4f3be7-4bf9-4d81-a3af-309cea4c6206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6350ab82-3973-4b8e-b62c-f8b2c89e7d02', 'volume_name': 'volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d70f6d4-15a2-4b6a-8be7-f554f27d6f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d70f6d4-15a2-4b6a-8be7-f554f27d6f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149adab4-1dfe-452a-85aa-4f3b6fb320fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:57 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Volume 6350ab82-3973-4b8e-b62c-f8b2c89e7d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02', 'volume_size': 1} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-842101825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6350ab82-3973-4b8e-b62c-f8b2c89e7d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5054e7ef9bc40e6b217e8b613f217fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:22:57Z,use_quota=True,user_id='018a3db175594a1a85b259a9834813d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Creating volume 6350ab82-3973-4b8e-b62c-f8b2c89e7d02 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:22:57 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:22:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:57 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 1073741824 Sep 01 11:22:57 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Acquiring lock "cinder-0e8c359c-8de9-4e41-9f92-3f99c89ada29-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Lock "cinder-0e8c359c-8de9-4e41-9f92-3f99c89ada29-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Acquiring lock "cinder-quobyte-0e8c359c-8de9-4e41-9f92-3f99c89ada29" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:22:58 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 1073741824" returned: 0 in 0.699s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Lock "cinder-quobyte-0e8c359c-8de9-4e41-9f92-3f99c89ada29" acquired by "delete_volume" :: waited 0.069s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca826d59-f0e4-4c16-be81-f222ee6385eb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:58 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 Sep 01 11:22:58 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:58 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 Sep 01 11:22:58 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:58 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02" returned: 0 in 0.416s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149adab4-1dfe-452a-85aa-4f3b6fb320fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ba9ff1-fdcf-44f7-8dd0-635ecfe91568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:22:58 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Volume volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 (6350ab82-3973-4b8e-b62c-f8b2c89e7d02): created successfully Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ba9ff1-fdcf-44f7-8dd0-635ecfe91568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:22:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Flow 'volume_create_manager' (e3456084-5e76-40e1-81ef-8fcbb22a7719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:22:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-94bad080-a925-48b2-9fa9-9dcdbcb2262b tempest-ServerRescueNegativeTestJSON-1115266330 None] Created volume successfully. Sep 01 11:22:59 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29" returned: 0 in 0.726s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:22:59 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29 Sep 01 11:22:59 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:22:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0e8c359c-8de9-4e41-9f92-3f99c89ada29" returned: 0 in 0.593s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:22:59 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Sep 01 11:22:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Lock "cinder-quobyte-0e8c359c-8de9-4e41-9f92-3f99c89ada29" released by "delete_volume" :: held 1.430s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:22:59 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Created reservations ['c46f5b1f-917d-4a55-9a57-3ba2666a2da3', 'de041722-4132-49c4-8743-9fcb08e56837', 'd7e8ed92-a0b2-43c9-970e-25ba3c546288', '2ec8fc83-f02a-41d7-b8ab-4e12c60c76ab'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:00 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:23:00 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:00 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.643s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:23:00 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Deleted volume successfully. Sep 01 11:23:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fde84f99-f4c5-4a0d-9d77-f2a568350023 tempest-TaggedAttachmentsTest-1583693653 None] Lock "cinder-0e8c359c-8de9-4e41-9f92-3f99c89ada29-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:04 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:23:04 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:05 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.637s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:23:09 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:23:10 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Flow 'volume_create_manager' (7c2f4ac7-90a7-411d-8be7-24c90ed71477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c69727-4b47-479b-a259-6ef7afbbe7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c69727-4b47-479b-a259-6ef7afbbe7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-976219392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7864345d-176f-413c-83d0-00a7ea4832d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b0e858269a472c82253c3b8bc82b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:23:21Z,use_quota=True,user_id='a06b634839c14471bf6d12e71e82c020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1c190d-9a0e-4fd7-b7c0-162855eaa33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1c190d-9a0e-4fd7-b7c0-162855eaa33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4c3a19-58ee-4377-a3a2-691fcef4dfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4c3a19-58ee-4377-a3a2-691fcef4dfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7864345d-176f-413c-83d0-00a7ea4832d2', 'volume_name': 'volume-7864345d-176f-413c-83d0-00a7ea4832d2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dc392a-c7e4-4e39-ad3e-f65c3424695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dc392a-c7e4-4e39-ad3e-f65c3424695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d44ff4-a454-4cee-9c7d-94981ad049f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Volume 7864345d-176f-413c-83d0-00a7ea4832d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7864345d-176f-413c-83d0-00a7ea4832d2', 'volume_size': 1} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-976219392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7864345d-176f-413c-83d0-00a7ea4832d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b0e858269a472c82253c3b8bc82b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:23:21Z,use_quota=True,user_id='a06b634839c14471bf6d12e71e82c020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Creating volume 7864345d-176f-413c-83d0-00a7ea4832d2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:23:21 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:23:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:21 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 1073741824 Sep 01 11:23:21 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:22 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 1073741824" returned: 0 in 0.767s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Acquiring lock "cinder-6350ab82-3973-4b8e-b62c-f8b2c89e7d02-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:23:22 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 Sep 01 11:23:22 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "cinder-6350ab82-3973-4b8e-b62c-f8b2c89e7d02-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Acquiring lock "cinder-quobyte-6350ab82-3973-4b8e-b62c-f8b2c89e7d02" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "cinder-quobyte-6350ab82-3973-4b8e-b62c-f8b2c89e7d02" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[151683d4-53e3-432e-b60e-12d84f93b6c4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:22 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 Sep 01 11:23:22 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:22 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2" returned: 0 in 0.476s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d44ff4-a454-4cee-9c7d-94981ad049f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7864345d-176f-413c-83d0-00a7ea4832d2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa53f7a-b193-434e-81a5-2b5972deb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Volume volume-7864345d-176f-413c-83d0-00a7ea4832d2 (7864345d-176f-413c-83d0-00a7ea4832d2): created successfully Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa53f7a-b193-434e-81a5-2b5972deb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Flow 'volume_create_manager' (7c2f4ac7-90a7-411d-8be7-24c90ed71477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-cb51b918-2a40-4005-951b-e4f416078af1 tempest-VolumesAdminNegativeTest-1732935548 None] Created volume successfully. Sep 01 11:23:22 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02" returned: 0 in 0.547s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:23 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02 Sep 01 11:23:23 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:23 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6350ab82-3973-4b8e-b62c-f8b2c89e7d02" returned: 0 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "cinder-quobyte-6350ab82-3973-4b8e-b62c-f8b2c89e7d02" released by "delete_volume" :: held 1.039s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Created reservations ['c623b1d5-2208-4381-94c1-28ac93357cfb', 'c45bb12c-f6b3-4625-8349-67843cb2ca68', '51efe8fb-6c67-4f0e-8d68-d57f9d6973c0', '031bdcbe-0a7f-480a-af34-7a83c304a786'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:23 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:23:23 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:24 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.508s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:23:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Deleted volume successfully. Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ba7e2424-5095-4ac5-a603-460caa4bfa36 tempest-ServerRescueNegativeTestJSON-1115266330 None] Lock "cinder-6350ab82-3973-4b8e-b62c-f8b2c89e7d02-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Acquiring lock "cinder-7864345d-176f-413c-83d0-00a7ea4832d2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "cinder-7864345d-176f-413c-83d0-00a7ea4832d2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Acquiring lock "cinder-quobyte-7864345d-176f-413c-83d0-00a7ea4832d2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "cinder-quobyte-7864345d-176f-413c-83d0-00a7ea4832d2" acquired by "delete_volume" :: waited 0.050s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c89c1a8-c9f3-4169-a403-9658d7464d9f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:23:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:24 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 Sep 01 11:23:24 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:25 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2" returned: 0 in 0.799s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:25 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2 Sep 01 11:23:25 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:26 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7864345d-176f-413c-83d0-00a7ea4832d2" returned: 0 in 0.804s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "cinder-quobyte-7864345d-176f-413c-83d0-00a7ea4832d2" released by "delete_volume" :: held 1.712s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Created reservations ['95029e98-b16a-4d01-add0-050103356d84', '23cdf2dd-7392-4532-8ae6-1a729d49052a', 'bc826ac4-eab9-4998-95a9-40a408e50e37', '3c560be7-736b-4ed1-b51c-43bb23ecc4e1'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:26 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:23:26 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:27 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.804s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:27 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:23:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Deleted volume successfully. Sep 01 11:23:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3423726-8ab7-40ae-a647-0e400194e139 tempest-VolumesAdminNegativeTest-1732935548 None] Lock "cinder-7864345d-176f-413c-83d0-00a7ea4832d2-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:23:36 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:23:37 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=11,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:23:51 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:23:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Flow 'volume_create_manager' (0ebffb23-e0fa-4b8a-99be-27603d1f038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d813f3-f331-4e18-90ed-564733f000b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d813f3-f331-4e18-90ed-564733f000b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1313341381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dae2877-80d9-4a6e-be8e-a4eeb3e73d26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='545a2d5740c24cbfb22e789b092b2e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:23:52Z,use_quota=True,user_id='9d7e5f1d704844e5a3f1e3471886653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df580d3a-8a96-4dd9-8052-dbc5474c2db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df580d3a-8a96-4dd9-8052-dbc5474c2db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581ec1b9-e1ae-4cc8-9e8f-294f029e6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581ec1b9-e1ae-4cc8-9e8f-294f029e6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dae2877-80d9-4a6e-be8e-a4eeb3e73d26', 'volume_name': 'volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f2be93-479e-4d7a-b120-e8c4b753d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f2be93-479e-4d7a-b120-e8c4b753d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc0d291-82fd-4715-8c5f-45f11ff461a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:52 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Volume 5dae2877-80d9-4a6e-be8e-a4eeb3e73d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26', 'volume_size': 1} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1313341381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dae2877-80d9-4a6e-be8e-a4eeb3e73d26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='545a2d5740c24cbfb22e789b092b2e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:23:52Z,use_quota=True,user_id='9d7e5f1d704844e5a3f1e3471886653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Creating volume 5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:23:52 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:52 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 1073741824 Sep 01 11:23:52 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:52 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 1073741824" returned: 0 in 0.498s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:52 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 Sep 01 11:23:52 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:52 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26" returned: 0 in 0.296s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc0d291-82fd-4715-8c5f-45f11ff461a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e67b02d-60d5-4a8d-870e-52a721480c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:52 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Volume volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 (5dae2877-80d9-4a6e-be8e-a4eeb3e73d26): created successfully Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e67b02d-60d5-4a8d-870e-52a721480c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Flow 'volume_create_manager' (0ebffb23-e0fa-4b8a-99be-27603d1f038d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-656e0e08-3c32-46af-be9d-91010bd36b1d tempest-VolumesTestJSON-1654698464 None] Created volume successfully. Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Flow 'volume_create_manager' (a622755e-8fc4-47c8-93a3-c19efb35d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5d5756-1f34-4af7-907d-2da8293aac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5d5756-1f34-4af7-907d-2da8293aac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1544959037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14639394-9558-48f9-ace1-0e19c8a2bad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='545a2d5740c24cbfb22e789b092b2e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:23:55Z,use_quota=True,user_id='9d7e5f1d704844e5a3f1e3471886653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59ac3e4-0a95-4df0-8166-dea9f9fc57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59ac3e4-0a95-4df0-8166-dea9f9fc57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64ffccf-4146-49b8-9f0e-557a3be0e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64ffccf-4146-49b8-9f0e-557a3be0e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14639394-9558-48f9-ace1-0e19c8a2bad1', 'volume_name': 'volume-14639394-9558-48f9-ace1-0e19c8a2bad1', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a89eb0-a720-4036-af67-03be3f2feb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a89eb0-a720-4036-af67-03be3f2feb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c92ef30-bd2e-4244-b73e-db834a39c231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:55 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Volume 14639394-9558-48f9-ace1-0e19c8a2bad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14639394-9558-48f9-ace1-0e19c8a2bad1', 'volume_size': 1} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1544959037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14639394-9558-48f9-ace1-0e19c8a2bad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='545a2d5740c24cbfb22e789b092b2e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:23:55Z,use_quota=True,user_id='9d7e5f1d704844e5a3f1e3471886653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Creating volume 14639394-9558-48f9-ace1-0e19c8a2bad1 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:23:55 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:23:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:55 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 1073741824 Sep 01 11:23:55 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:56 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 1073741824" returned: 0 in 0.634s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:23:56 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 Sep 01 11:23:56 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:23:56 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c92ef30-bd2e-4244-b73e-db834a39c231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14639394-9558-48f9-ace1-0e19c8a2bad1', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06190c08-befc-40be-b192-dfc688dd3acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:23:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Volume volume-14639394-9558-48f9-ace1-0e19c8a2bad1 (14639394-9558-48f9-ace1-0e19c8a2bad1): created successfully Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06190c08-befc-40be-b192-dfc688dd3acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:23:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Flow 'volume_create_manager' (a622755e-8fc4-47c8-93a3-c19efb35d792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7f14732e-4601-4d04-8c77-9f412e1a79e2 tempest-VolumesTestJSON-1654698464 None] Created volume successfully. Sep 01 11:23:59 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:23:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Flow 'volume_create_manager' (4259a91a-588e-40f4-959c-da1f866efa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:23:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44570a3-4d63-4126-a692-13b27a8bcede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44570a3-4d63-4126-a692-13b27a8bcede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-709734701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b15f667-72e2-4173-8927-cc6d3f2ffeff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='545a2d5740c24cbfb22e789b092b2e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:00Z,use_quota=True,user_id='9d7e5f1d704844e5a3f1e3471886653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05b4de3-849d-4ef3-95fa-07787fcb8d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05b4de3-849d-4ef3-95fa-07787fcb8d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6c7ff5-e3ca-49c5-84ba-784eaaa4a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6c7ff5-e3ca-49c5-84ba-784eaaa4a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b15f667-72e2-4173-8927-cc6d3f2ffeff', 'volume_name': 'volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0dded6-ece7-4c3c-8c64-c5c4cac69b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0dded6-ece7-4c3c-8c64-c5c4cac69b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1b51ee-9771-4e57-8950-6295c981f8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:00 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Volume 5b15f667-72e2-4173-8927-cc6d3f2ffeff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff', 'volume_size': 1} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-709734701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b15f667-72e2-4173-8927-cc6d3f2ffeff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='545a2d5740c24cbfb22e789b092b2e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:00Z,use_quota=True,user_id='9d7e5f1d704844e5a3f1e3471886653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Creating volume 5b15f667-72e2-4173-8927-cc6d3f2ffeff {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:00 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:00 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff 1073741824 Sep 01 11:24:00 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:01 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff 1073741824" returned: 0 in 1.067s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:01 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff Sep 01 11:24:01 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:01 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff" returned: 0 in 0.527s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1b51ee-9771-4e57-8950-6295c981f8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7646fe73-5adc-4f5c-a777-bd3ce312fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Volume volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff (5b15f667-72e2-4173-8927-cc6d3f2ffeff): created successfully Sep 01 11:24:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7646fe73-5adc-4f5c-a777-bd3ce312fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Flow 'volume_create_manager' (4259a91a-588e-40f4-959c-da1f866efa05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1336cff3-033f-4279-8d1d-18996710afa8 tempest-VolumesTestJSON-1654698464 None] Created volume successfully. Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "cinder-5b15f667-72e2-4173-8927-cc6d3f2ffeff-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Lock "cinder-5b15f667-72e2-4173-8927-cc6d3f2ffeff-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "cinder-quobyte-5b15f667-72e2-4173-8927-cc6d3f2ffeff" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Lock "cinder-quobyte-5b15f667-72e2-4173-8927-cc6d3f2ffeff" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0589a77f-d85b-465e-b47f-e16dd8a95065]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:04 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:04 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:04 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff Sep 01 11:24:04 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:05 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.557s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 8 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:24:05 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff" returned: 0 in 1.053s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:05 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff Sep 01 11:24:05 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:05 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5b15f667-72e2-4173-8927-cc6d3f2ffeff" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Lock "cinder-quobyte-5b15f667-72e2-4173-8927-cc6d3f2ffeff" released by "delete_volume" :: held 1.614s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Created reservations ['c2d5d03c-29e9-40e4-b4bf-ba49e819f460', '25d1355b-2c85-4daa-a606-54b3a320d36a', '996246d9-2c3a-41d6-9235-15ce00c8f401', 'a797e7d3-574c-40e4-b358-74093c3ed895'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:06 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:06 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Acquiring lock "cinder-14639394-9558-48f9-ace1-0e19c8a2bad1-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Lock "cinder-14639394-9558-48f9-ace1-0e19c8a2bad1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:07 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.804s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Deleted volume successfully. Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Acquiring lock "cinder-quobyte-14639394-9558-48f9-ace1-0e19c8a2bad1" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-16b7b834-22b2-4f1d-a1ba-0bcd8455d8d8 tempest-VolumesTestJSON-1654698464 None] Lock "cinder-5b15f667-72e2-4173-8927-cc6d3f2ffeff-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Lock "cinder-quobyte-14639394-9558-48f9-ace1-0e19c8a2bad1" acquired by "delete_volume" :: waited 0.049s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc6bab-6181-4c81-950e-cad21485c74f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:07 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 Sep 01 11:24:07 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:07 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1" returned: 0 in 0.666s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:08 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1 Sep 01 11:24:08 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:08 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-14639394-9558-48f9-ace1-0e19c8a2bad1" returned: 0 in 0.516s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Lock "cinder-quobyte-14639394-9558-48f9-ace1-0e19c8a2bad1" released by "delete_volume" :: held 1.238s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Created reservations ['99cba016-8b1a-4e41-b8da-f33ebb8fe678', '52cf5acd-8aa0-4e17-bcf3-6afe2ee031f4', '84d75da9-eb48-47e8-aa80-ea94a355aaf1', '1fde00af-f380-4581-b8a4-2a47f6b8e67c'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:08 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:08 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:09 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.416s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Deleted volume successfully. Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4f8b636a-7cb3-4600-bbc8-2a672bd5970e tempest-VolumesTestJSON-1654698464 None] Lock "cinder-14639394-9558-48f9-ace1-0e19c8a2bad1-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Acquiring lock "cinder-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Lock "cinder-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Acquiring lock "cinder-quobyte-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Lock "cinder-quobyte-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26" acquired by "delete_volume" :: waited 0.069s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d43c95f-8d6e-4b3f-8161-660ee120d444]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:09 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 Sep 01 11:24:09 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:10 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26" returned: 0 in 0.569s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:10 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26 Sep 01 11:24:10 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:10 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26" returned: 0 in 0.298s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Lock "cinder-quobyte-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26" released by "delete_volume" :: held 0.928s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Created reservations ['4919f5aa-31db-4b37-8baa-0ac19f3a1b19', 'b4982485-fb31-4358-baed-c4219dd82e41', '15405921-3a88-41a3-92e8-3da4048fedee', '99a5938f-6322-4304-b478-3a800ada236e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:10 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:10 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:11 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.358s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:11 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Deleted volume successfully. Sep 01 11:24:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-996522dd-758a-445c-9890-86685635079a tempest-VolumesTestJSON-1654698464 None] Lock "cinder-5dae2877-80d9-4a6e-be8e-a4eeb3e73d26-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4ffe0bac-4937-465e-b4f9-899945e646c5 tempest-GroupSnapshotsTest-362684245 None] Group tempest-GroupSnapshotsTest-Group-1428396042: creating Sep 01 11:24:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4ffe0bac-4937-465e-b4f9-899945e646c5 tempest-GroupSnapshotsTest-362684245 None] Group tempest-GroupSnapshotsTest-Group-1428396042: created successfully Sep 01 11:24:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4ffe0bac-4937-465e-b4f9-899945e646c5 tempest-GroupSnapshotsTest-362684245 None] Create group completed successfully. Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (7d4cf503-df64-4300-92c2-7370d559b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65731058-0a4a-49b3-9a94-7ed922caaaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65731058-0a4a-49b3-9a94-7ed922caaaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319502658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1bd3a7e-f09b-41b8-b5d0-320a73df2ddf,host='devstack@QuobyteHD#QuobyteHD',id=2db40d5b-d6ef-4d11-95b4-2d91e5c976f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:18Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7db6a4cc-1242-4c95-9cf5-64c61a738831),volume_type_id=7db6a4cc-1242-4c95-9cf5-64c61a738831)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f10d57-a146-48e8-98e1-c9ad3edd3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f10d57-a146-48e8-98e1-c9ad3edd3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf4feb7-de22-481a-a1f3-51948ab70f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf4feb7-de22-481a-a1f3-51948ab70f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db40d5b-d6ef-4d11-95b4-2d91e5c976f7', 'volume_name': 'volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32769f68-b469-4017-a695-17068bfe29aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32769f68-b469-4017-a695-17068bfe29aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29ae37d-08d2-4daf-89b1-3fa81953b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Volume 2db40d5b-d6ef-4d11-95b4-2d91e5c976f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7', 'volume_size': 1} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1bd3a7e-f09b-41b8-b5d0-320a73df2ddf,created_at=2026-09-01T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319502658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1bd3a7e-f09b-41b8-b5d0-320a73df2ddf,host='devstack@QuobyteHD#QuobyteHD',id=2db40d5b-d6ef-4d11-95b4-2d91e5c976f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:18Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7db6a4cc-1242-4c95-9cf5-64c61a738831),volume_type_id=7db6a4cc-1242-4c95-9cf5-64c61a738831)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Creating volume 2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:17 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:17 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 1073741824 Sep 01 11:24:17 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:18 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 1073741824" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:18 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:18 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:18 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29ae37d-08d2-4daf-89b1-3fa81953b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfa48bf-8bce-46f9-9a8f-edc9d68537d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Volume volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 (2db40d5b-d6ef-4d11-95b4-2d91e5c976f7): created successfully Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfa48bf-8bce-46f9-9a8f-edc9d68537d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (7d4cf503-df64-4300-92c2-7370d559b61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-07628340-c022-43a6-a52d-a6f10761b5f9 tempest-GroupSnapshotsTest-362684245 None] Created volume successfully. Sep 01 11:24:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] GroupSnapshot 54ce70cc-7f98-49c7-9e06-c3379c24695f: creating. Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Group snapshot 54ce70cc-7f98-49c7-9e06-c3379c24695f: creating. {{(pid=87144) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Creating offline snapshot 0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 of volume 2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d87d4b-ea3f-46be-907d-8c91f9ca717d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:19 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:19 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:19 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.424s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:19 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 1G Sep 01 11:24:19 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:20 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 1G" returned: 0 in 0.638s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:20 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 Sep 01 11:24:20 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:20 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" returned: 0 in 0.352s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:20 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:24:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:20 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 Sep 01 11:24:20 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:21 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" returned: 0 in 0.266s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:21 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info Sep 01 11:24:21 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:21 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info" returned: 0 in 0.255s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:21 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:24:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:21 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info Sep 01 11:24:21 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:21 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.info" returned: 0 in 0.282s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-192b7423-36a8-4533-917f-d54483afa03c tempest-GroupSnapshotsTest-362684245 None] group_snapshot 54ce70cc-7f98-49c7-9e06-c3379c24695f: created successfully Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-0eab3b07-8b49-4f05-bd85-6a3d9fd177c9-d17ca3ff-e187-4236-a53c-0c1501628f60" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-0eab3b07-8b49-4f05-bd85-6a3d9fd177c9-d17ca3ff-e187-4236-a53c-0c1501628f60" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Creating volume d17ca3ff-e187-4236-a53c-0c1501628f60 from snapshot 0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-d17ca3ff-e187-4236-a53c-0c1501628f60" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-d17ca3ff-e187-4236-a53c-0c1501628f60" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] snapshot: 0eab3b07-8b49-4f05-bd85-6a3d9fd177c9, volume: d17ca3ff-e187-4236-a53c-0c1501628f60, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4470aa-04ec-4cdb-bfb9-d5e8aecec089]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:23 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 Sep 01 11:24:23 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:23 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" returned: 0 in 0.538s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf33e3-f972-42ec-9767-bc707b718cf9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:24 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:24 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Flow 'volume_create_manager' (32959b36-f548-4f13-9a8f-18e9d1dea369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1f7a17-d081-41a5-8ab4-eeed71cd151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1f7a17-d081-41a5-8ab4-eeed71cd151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-290744816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f743be-b84e-4e65-b80f-eb167b88064c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d277a0645bb4ba7a48bd3911b9e3dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:24Z,use_quota=True,user_id='d8cad01fadda4bffb35fcd792bd5cd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c90746-1e25-46eb-a7f9-07b97e3fddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c90746-1e25-46eb-a7f9-07b97e3fddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e38c805-fa8a-4f76-80da-d8447ce88a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e38c805-fa8a-4f76-80da-d8447ce88a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f743be-b84e-4e65-b80f-eb167b88064c', 'volume_name': 'volume-a9f743be-b84e-4e65-b80f-eb167b88064c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc3127f-a154-413c-98dd-8f932c16934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc3127f-a154-413c-98dd-8f932c16934c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb0ea6-d99c-45de-8667-36d642b7862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:24 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Volume a9f743be-b84e-4e65-b80f-eb167b88064c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f743be-b84e-4e65-b80f-eb167b88064c', 'volume_size': 1} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:24 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.411s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:24:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:24 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 Sep 01 11:24:24 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:29 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:24:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Flow 'volume_create_manager' (08753611-c196-4b73-8844-45296c5ca728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0cbd3e-24ca-4152-ab52-507f28e97bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0cbd3e-24ca-4152-ab52-507f28e97bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2089221817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f386ed-de92-4d46-bfd6-b28f3853a936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52019a760fa4001b794756728bd6f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:30Z,use_quota=True,user_id='40d40c9315dc458eb4a1f7146dc34f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fd6e46-53ea-4309-9a31-821cfd275d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fd6e46-53ea-4309-9a31-821cfd275d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7877f8-b4b2-4294-80e0-219a515688da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7877f8-b4b2-4294-80e0-219a515688da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f386ed-de92-4d46-bfd6-b28f3853a936', 'volume_name': 'volume-b2f386ed-de92-4d46-bfd6-b28f3853a936', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ee0470-0953-4d78-9968-38b4a795a7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ee0470-0953-4d78-9968-38b4a795a7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41406885-9800-4369-b680-5177dba0e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Volume b2f386ed-de92-4d46-bfd6-b28f3853a936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f386ed-de92-4d46-bfd6-b28f3853a936', 'volume_size': 1} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:30 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60" returned: 0 in 6.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9679d37b-74da-4e98-82ff-6fdcd99a965c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:30 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:30 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:31 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.826s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:24:31 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Converted 1024.00 MB image at 162.42 MB/s Sep 01 11:24:31 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:31 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 Sep 01 11:24:31 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:31 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60" returned: 0 in 0.320s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-d17ca3ff-e187-4236-a53c-0c1501628f60" released by "_copy_volume_from_snapshot" :: held 8.517s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-0eab3b07-8b49-4f05-bd85-6a3d9fd177c9-d17ca3ff-e187-4236-a53c-0c1501628f60" released by "_create_volume_from_snapshot" :: held 8.573s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.597s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.596s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-290744816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f743be-b84e-4e65-b80f-eb167b88064c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d277a0645bb4ba7a48bd3911b9e3dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:24Z,use_quota=True,user_id='d8cad01fadda4bffb35fcd792bd5cd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Creating volume a9f743be-b84e-4e65-b80f-eb167b88064c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:31 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:31 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c 1073741824 Sep 01 11:24:31 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-df02a124-8933-41f0-89ae-8de08023637c tempest-GroupSnapshotsTest-362684245 None] Create group from source-snapshot-54ce70cc-7f98-49c7-9e06-c3379c24695f completed successfully. Sep 01 11:24:32 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c 1073741824" returned: 0 in 0.611s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:32 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c Sep 01 11:24:32 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:32 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.941s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2089221817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f386ed-de92-4d46-bfd6-b28f3853a936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52019a760fa4001b794756728bd6f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:30Z,use_quota=True,user_id='40d40c9315dc458eb4a1f7146dc34f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Creating volume b2f386ed-de92-4d46-bfd6-b28f3853a936 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:33 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb0ea6-d99c-45de-8667-36d642b7862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f743be-b84e-4e65-b80f-eb167b88064c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:33 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 1073741824 Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43d2a40-d3c5-4244-bf2a-a56f8fbad951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:33 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Volume volume-a9f743be-b84e-4e65-b80f-eb167b88064c (a9f743be-b84e-4e65-b80f-eb167b88064c): created successfully Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43d2a40-d3c5-4244-bf2a-a56f8fbad951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Flow 'volume_create_manager' (32959b36-f548-4f13-9a8f-18e9d1dea369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-70c8abdd-0bc5-48a5-a081-8b0b0135bcec tempest-AttachVolumeTestJSON-439105632 None] Created volume successfully. Sep 01 11:24:34 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 1073741824" returned: 0 in 1.158s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:34 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 Sep 01 11:24:34 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-d17ca3ff-e187-4236-a53c-0c1501628f60" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-d17ca3ff-e187-4236-a53c-0c1501628f60" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[38457883-30d1-43f7-a9a1-c033f9dac58a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:34 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 Sep 01 11:24:34 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:34 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936" returned: 0 in 0.484s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41406885-9800-4369-b680-5177dba0e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f386ed-de92-4d46-bfd6-b28f3853a936', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835f9c25-1658-4ab2-a92d-78fdbc5122fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:34 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Volume volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 (b2f386ed-de92-4d46-bfd6-b28f3853a936): created successfully Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835f9c25-1658-4ab2-a92d-78fdbc5122fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Flow 'volume_create_manager' (08753611-c196-4b73-8844-45296c5ca728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:34 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d4adb22f-553e-4596-a85a-5cf515f09449 tempest-ServerActionsTestOtherA-233561984 None] Created volume successfully. Sep 01 11:24:35 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60" returned: 0 in 0.630s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:35 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60 Sep 01 11:24:35 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d866a21-05ff-48e9-a655-27cd9e7e7e49]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:35 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d17ca3ff-e187-4236-a53c-0c1501628f60" returned: 0 in 0.533s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-d17ca3ff-e187-4236-a53c-0c1501628f60" released by "delete_volume" :: held 1.228s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:35 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c Sep 01 11:24:35 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Created reservations ['b098aa6f-46ce-4bf9-961c-a7e6ac470937'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:35 devstack cinder-volume[87144]: WARNING cinder.quota [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1135102412 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1135102412, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:24:35 devstack cinder-volume[87144]: WARNING cinder.quota [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1135102412 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1135102412, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:24:35 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Created reservations ['2bd9e63a-e833-47ea-a7c8-49fd5af2fcb6', '5ecc59c3-f60b-4819-9606-81df44a51bbf', '299160b1-1560-454e-976f-2b479ec13f06', '6f51b3c6-af09-4e93-a675-c00eb263b78f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:36 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:36 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:36 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c" returned: 0 in 0.656s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.685s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-a9f743be-b84e-4e65-b80f-eb167b88064c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6d15580-ff29-4f79-a072-8baae17495ab', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:24:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-85be6584-7a0c-414e-ad4a-c67313ce9278 req-64caf800-ed12-4024-8712-33bcc6b7e9c7 tempest-AttachVolumeTestJSON-439105632 None] attachment_update completed successfully. Sep 01 11:24:36 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:36 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-04c9ebc3-350c-4d13-bbd2-f4b4b619ac1b tempest-GroupSnapshotsTest-362684245 None] Delete group completed successfully. Sep 01 11:24:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 54ce70cc-7f98-49c7-9e06-c3379c24695f: deleting Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 54ce70cc-7f98-49c7-9e06-c3379c24695f: deleting {{(pid=87144) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Deleting offline snapshot 0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 of volume 2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] snapshot_file for this snap is: volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879b87f-3d18-4a04-99d6-e8383622804c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:37 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 Sep 01 11:24:37 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:38 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" returned: 0 in 0.582s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:24:38 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f51d7-1995-4380-a66a-92df47bd002f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:38 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:38 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:39 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.809s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:39 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 Sep 01 11:24:39 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:39 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" returned: 0 in 0.846s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:40 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9 Sep 01 11:24:40 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Flow 'volume_create_manager' (66e999ba-9670-4566-8602-318c18bed100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98be4486-09be-43f1-b3c3-173a8c74aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98be4486-09be-43f1-b3c3-173a8c74aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-937991627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fffb44d-9ad5-4ba5-b730-4ef84f8163d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d277a0645bb4ba7a48bd3911b9e3dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:40Z,use_quota=True,user_id='d8cad01fadda4bffb35fcd792bd5cd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82535e20-6c08-4b26-a72f-a8cd12f6c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82535e20-6c08-4b26-a72f-a8cd12f6c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d88d067-b690-402b-ae56-c5838994b85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d88d067-b690-402b-ae56-c5838994b85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fffb44d-9ad5-4ba5-b730-4ef84f8163d1', 'volume_name': 'volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e97a0ce-c435-44c0-a9af-5cc00bb3f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e97a0ce-c435-44c0-a9af-5cc00bb3f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47038b05-ddc3-45b1-be3f-fb1425f14ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Volume 5fffb44d-9ad5-4ba5-b730-4ef84f8163d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1', 'volume_size': 1} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-937991627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fffb44d-9ad5-4ba5-b730-4ef84f8163d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d277a0645bb4ba7a48bd3911b9e3dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:40Z,use_quota=True,user_id='d8cad01fadda4bffb35fcd792bd5cd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Creating volume 5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:40 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:40 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 1073741824 Sep 01 11:24:40 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:40 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7.0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" returned: 0 in 0.562s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-0eab3b07-8b49-4f05-bd85-6a3d9fd177c9" released by "_delete_snapshot" :: held 2.988s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" released by "delete_snapshot" :: held 3.047s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:40 devstack cinder-volume[87144]: WARNING cinder.quota [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1135102412 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1135102412, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:24:40 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['ac12537a-f3d1-45e9-84e0-c66aaac4d947', '0bcf6d30-d91b-4423-995d-1398319fe0b1', '23c51899-1e7e-4b8a-adf1-c80547f7e5f1', '5a1d83aa-3836-4f98-abcd-cf0f29b5d3ba'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-97d9f3fc-ecbc-4a0c-bfcc-9fe720b32293 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 54ce70cc-7f98-49c7-9e06-c3379c24695f: deleted successfully Sep 01 11:24:41 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 1073741824" returned: 0 in 0.740s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:41 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 Sep 01 11:24:41 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" acquired by "delete_volume" :: waited 0.037s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:41 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" returned: 0 in 0.335s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47038b05-ddc3-45b1-be3f-fb1425f14ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0b8ac3-e892-4e6e-b5b3-13f52fcf421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a6c11-4195-454d-bd9c-cdcb401ff9a4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:41 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Volume volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 (5fffb44d-9ad5-4ba5-b730-4ef84f8163d1): created successfully Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0b8ac3-e892-4e6e-b5b3-13f52fcf421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Flow 'volume_create_manager' (66e999ba-9670-4566-8602-318c18bed100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bcb4b340-cbaa-4890-87ec-6cd9e38d3d15 tempest-AttachVolumeTestJSON-439105632 None] Created volume successfully. Sep 01 11:24:41 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:41 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:42 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.571s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:42 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7 Sep 01 11:24:42 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:42 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" returned: 0 in 0.333s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-2db40d5b-d6ef-4d11-95b4-2d91e5c976f7" released by "delete_volume" :: held 1.022s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['6edafa01-7bdc-436f-9610-bca8b6189c16'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:42 devstack cinder-volume[87144]: WARNING cinder.db.api [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1135102412'] Sep 01 11:24:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['03c49766-fafc-47a5-99ba-51e60f5323e1', '9e5f7fcf-69d8-49e6-81f5-990a079730e8', '3c34de64-542c-44f3-8ad7-2bf412bc8f2b', '778c20bf-57a1-4caa-bede-d4220a7bf05d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:43 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:43 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:43 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.672s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0c6f05f9-9f2c-4aa8-89be-f4ff5bc27600 tempest-GroupSnapshotsTest-362684245 None] Delete group completed successfully. Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f030a-30d6-450d-a589-b3a683bacfd3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:44 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 Sep 01 11:24:44 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:44 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" returned: 0 in 0.648s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.686s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c770bd3d-d554-4932-98e2-a17e18ff5484 tempest-GroupSnapshotsTest-362684245 None] Group tempest-GroupSnapshotsTest-Group-709484935: creating Sep 01 11:24:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aed896ac-93a8-47a5-81c2-6897d6266886', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:24:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c770bd3d-d554-4932-98e2-a17e18ff5484 tempest-GroupSnapshotsTest-362684245 None] Group tempest-GroupSnapshotsTest-Group-709484935: created successfully Sep 01 11:24:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c770bd3d-d554-4932-98e2-a17e18ff5484 tempest-GroupSnapshotsTest-362684245 None] Create group completed successfully. Sep 01 11:24:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-a2512a5f-ed35-499d-a747-82f096f6d966 req-6a6716b6-e77e-4dc9-be21-dc72b72d931e tempest-AttachVolumeTestJSON-439105632 None] attachment_update completed successfully. Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=83,cinder:UPDATE=72,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (7ba766e1-a770-461b-87cb-f2e3c2607c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dae80d6-2464-4fa2-8929-5cc5f35f93b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dae80d6-2464-4fa2-8929-5cc5f35f93b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127126519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c06134d-626b-4c75-bb17-167acebabd47,host='devstack@QuobyteHD#QuobyteHD',id=22878aae-5230-4690-9f36-8ebbc7014694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:47Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a058e436-116b-4f4d-882f-c0407d2d7fd0),volume_type_id=a058e436-116b-4f4d-882f-c0407d2d7fd0)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46717b2a-6173-4fa3-b047-8017fa234d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46717b2a-6173-4fa3-b047-8017fa234d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4a88f2-a5ee-48e6-84ae-87ac236ec04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4a88f2-a5ee-48e6-84ae-87ac236ec04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22878aae-5230-4690-9f36-8ebbc7014694', 'volume_name': 'volume-22878aae-5230-4690-9f36-8ebbc7014694', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eec0c1-8da9-4843-929a-2c99da05d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eec0c1-8da9-4843-929a-2c99da05d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af561bb-1c28-420f-b77c-f13c0cace61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:46 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Volume 22878aae-5230-4690-9f36-8ebbc7014694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22878aae-5230-4690-9f36-8ebbc7014694', 'volume_size': 1} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c06134d-626b-4c75-bb17-167acebabd47,created_at=2026-09-01T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127126519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c06134d-626b-4c75-bb17-167acebabd47,host='devstack@QuobyteHD#QuobyteHD',id=22878aae-5230-4690-9f36-8ebbc7014694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:47Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a058e436-116b-4f4d-882f-c0407d2d7fd0),volume_type_id=a058e436-116b-4f4d-882f-c0407d2d7fd0)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Creating volume 22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:46 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:47 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 1073741824 Sep 01 11:24:47 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:47 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 1073741824" returned: 0 in 0.802s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:47 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=91,cinder:SELECT=75,cinder:DELETE=6,cinder:INSERT=16 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:24:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:47 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 Sep 01 11:24:47 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-486f17ce-4634-4a23-b9ef-9772603959c9 req-02934b34-a5c1-409e-960f-5c11f8b1c0f4 tempest-AttachVolumeTestJSON-439105632 None] Terminate volume connection completed successfully. Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-486f17ce-4634-4a23-b9ef-9772603959c9 req-02934b34-a5c1-409e-960f-5c11f8b1c0f4 tempest-AttachVolumeTestJSON-439105632 None] Deleting attachment e6d15580-ff29-4f79-a072-8baae17495ab. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:24:48 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694" returned: 0 in 0.548s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af561bb-1c28-420f-b77c-f13c0cace61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22878aae-5230-4690-9f36-8ebbc7014694', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0554087a-0c3c-474b-9f6c-56f2eefbc657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Volume volume-22878aae-5230-4690-9f36-8ebbc7014694 (22878aae-5230-4690-9f36-8ebbc7014694): created successfully Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0554087a-0c3c-474b-9f6c-56f2eefbc657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (7ba766e1-a770-461b-87cb-f2e3c2607c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fde09795-a270-47ed-8f32-a791c9e94156 tempest-GroupSnapshotsTest-362684245 None] Created volume successfully. Sep 01 11:24:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-5f24465d-5329-4e64-bb08-ade24455bc6e req-7f210181-b80b-420c-9c69-5b79a79c7991 tempest-AttachVolumeTestJSON-439105632 None] Terminate volume connection completed successfully. Sep 01 11:24:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-5f24465d-5329-4e64-bb08-ade24455bc6e req-7f210181-b80b-420c-9c69-5b79a79c7991 tempest-AttachVolumeTestJSON-439105632 None] Deleting attachment aed896ac-93a8-47a5-81c2-6897d6266886. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (ae11118d-6005-487b-81b9-056f80eadbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3f4cf9-d62c-47ec-b0ff-4e8d150372f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3f4cf9-d62c-47ec-b0ff-4e8d150372f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498162616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c06134d-626b-4c75-bb17-167acebabd47,host='devstack@QuobyteHD#QuobyteHD',id=92776ab9-c760-492d-9d82-432add5f4fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:50Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a058e436-116b-4f4d-882f-c0407d2d7fd0),volume_type_id=a058e436-116b-4f4d-882f-c0407d2d7fd0)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a98d432-20cc-4770-a334-65b9e4ac6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a98d432-20cc-4770-a334-65b9e4ac6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfd6f97-e205-4251-88e4-066631e019c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfd6f97-e205-4251-88e4-066631e019c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92776ab9-c760-492d-9d82-432add5f4fc5', 'volume_name': 'volume-92776ab9-c760-492d-9d82-432add5f4fc5', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17cd235-d351-4b04-b765-4301b5deca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17cd235-d351-4b04-b765-4301b5deca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd637a5-7210-46f3-a05e-141a0ebe49f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:50 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Volume 92776ab9-c760-492d-9d82-432add5f4fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92776ab9-c760-492d-9d82-432add5f4fc5', 'volume_size': 1} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c06134d-626b-4c75-bb17-167acebabd47,created_at=2026-09-01T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498162616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c06134d-626b-4c75-bb17-167acebabd47,host='devstack@QuobyteHD#QuobyteHD',id=92776ab9-c760-492d-9d82-432add5f4fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:24:50Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a058e436-116b-4f4d-882f-c0407d2d7fd0),volume_type_id=a058e436-116b-4f4d-882f-c0407d2d7fd0)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Creating volume 92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:24:50 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:50 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 1073741824 Sep 01 11:24:50 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:50 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 1073741824" returned: 0 in 0.484s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:50 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 Sep 01 11:24:50 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:51 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5" returned: 0 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd637a5-7210-46f3-a05e-141a0ebe49f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92776ab9-c760-492d-9d82-432add5f4fc5', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f661de1a-049b-48b6-9398-902c56a32e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:24:51 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Volume volume-92776ab9-c760-492d-9d82-432add5f4fc5 (92776ab9-c760-492d-9d82-432add5f4fc5): created successfully Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f661de1a-049b-48b6-9398-902c56a32e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:24:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (ae11118d-6005-487b-81b9-056f80eadbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:24:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fc330c76-b3e1-4d3b-99c3-dee16765569d tempest-GroupSnapshotsTest-362684245 None] Created volume successfully. Sep 01 11:24:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-42da360f-790f-48dc-a8ab-87cafdb44b95 tempest-GroupSnapshotsTest-362684245 None] Update group completed successfully. Sep 01 11:24:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bb63855d-cc6f-44ca-b1f8-3420d891da49 tempest-GroupSnapshotsTest-362684245 None] Update group completed successfully. Sep 01 11:24:54 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0285c3cd-ac7a-417a-988f-1c0fe9f7092f tempest-GroupSnapshotsTest-362684245 None] Update group completed successfully. Sep 01 11:24:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "cinder-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "cinder-quobyte-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-quobyte-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" acquired by "delete_volume" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb8aef-10ee-4f3d-83aa-61a9e04e2af3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:55 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 Sep 01 11:24:55 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:55 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" returned: 0 in 0.395s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:55 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1 Sep 01 11:24:55 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:55 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fd8db8f8-eb49-4bd6-8050-0d0d6c373ba4 tempest-GroupSnapshotsTest-362684245 None] Update group completed successfully. Sep 01 11:24:55 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" returned: 0 in 0.351s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-quobyte-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1" released by "delete_volume" :: held 0.803s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Created reservations ['9e5a47d9-003a-480c-9f71-c1c59210fd7e', 'c860ba37-ea29-42ac-9f5f-1d091bfc0442', '745c04d6-95e7-407f-a17e-f9c31c633d7c', '1d04fa9c-9eb9-4a4f-9860-d17763bb2027'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:55 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:55 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:56 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Deleted volume successfully. Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "cinder-a9f743be-b84e-4e65-b80f-eb167b88064c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-a9f743be-b84e-4e65-b80f-eb167b88064c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-93655870-7f2c-4aad-aa95-2c155471fbe9 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-5fffb44d-9ad5-4ba5-b730-4ef84f8163d1-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "cinder-quobyte-a9f743be-b84e-4e65-b80f-eb167b88064c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-quobyte-a9f743be-b84e-4e65-b80f-eb167b88064c" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f305d87-59eb-4e62-ac8f-75b805075ada]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:56 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c Sep 01 11:24:56 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:56 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c" returned: 0 in 0.430s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:56 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c Sep 01 11:24:56 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:56 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9f743be-b84e-4e65-b80f-eb167b88064c" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-quobyte-a9f743be-b84e-4e65-b80f-eb167b88064c" released by "delete_volume" :: held 0.775s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Created reservations ['dfeab2ee-a3fb-4148-b7c2-8ac4a6d014d3', '0ea42bed-5a00-4f5e-b558-a6eb1f6eb566', 'faa4a4a5-47de-4122-aa72-6d5eb3636913', 'dad1b663-3045-4c2f-9698-1a436f7a251b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:57 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] GroupSnapshot 9bceda3d-74ad-4373-86f8-970050681733: creating. Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Group snapshot 9bceda3d-74ad-4373-86f8-970050681733: creating. {{(pid=87144) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:57 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:57 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Creating offline snapshot 53233b92-0da3-42b5-b8b0-290c1857becb of volume 22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3ccdb7-63c7-4803-93c1-b0ec01d7ad63]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:57 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 Sep 01 11:24:57 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "cinder-86c27c4f-142a-43a5-a9af-e78b9939eb75-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:57 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.327s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:57 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Deleted volume successfully. Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-86c27c4f-142a-43a5-a9af-e78b9939eb75-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-60a4fd4c-1bab-4522-ac21-6e57e6cc44e6 tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-a9f743be-b84e-4e65-b80f-eb167b88064c-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "cinder-quobyte-86c27c4f-142a-43a5-a9af-e78b9939eb75" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-quobyte-86c27c4f-142a-43a5-a9af-e78b9939eb75" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a513c-37c8-4ce0-ac8b-a5974b29a706]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:57 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694" returned: 0 in 0.492s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:57 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb 1G Sep 01 11:24:57 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:57 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 Sep 01 11:24:57 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:58 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75" returned: 0 in 0.419s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:58 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75 Sep 01 11:24:58 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:58 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb 1G" returned: 0 in 0.431s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22878aae-5230-4690-9f36-8ebbc7014694 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:58 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22878aae-5230-4690-9f36-8ebbc7014694 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb Sep 01 11:24:58 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:58 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-86c27c4f-142a-43a5-a9af-e78b9939eb75" returned: 0 in 0.288s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-quobyte-86c27c4f-142a-43a5-a9af-e78b9939eb75" released by "delete_volume" :: held 0.750s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Created reservations ['c20383dc-bcb4-4a0c-b6ed-c95b5e52a168', '5e34be83-7841-4a32-9be9-199ffedec216', 'aa339299-a9a7-42c8-ac93-f4c3346918ea', '27361dc7-e0c3-473a-a8e5-bb6998f18a51'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:58 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22878aae-5230-4690-9f36-8ebbc7014694 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb" returned: 0 in 0.373s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:58 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:58 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:24:58 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:58 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb Sep 01 11:24:58 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:58 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:24:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Deleted volume successfully. Sep 01 11:24:58 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb" returned: 0 in 0.305s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17c6e91-c0d3-495c-bc49-a858f81d991d tempest-AttachVolumeTestJSON-439105632 None] Lock "cinder-86c27c4f-142a-43a5-a9af-e78b9939eb75-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:24:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:59 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info Sep 01 11:24:59 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:59 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:59 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:59 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info Sep 01 11:24:59 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:24:59 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.info" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Creating offline snapshot da5979ca-8dd5-4f9b-a912-e78e5a70df89 of volume 92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eec4c2-9a82-4f20-b53a-a50cbea20b6e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:24:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:24:59 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 Sep 01 11:24:59 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:00 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Flow 'volume_create_manager' (6ab0ba1e-adda-4fc1-9e59-8c23d662ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4c162-923c-4771-97e7-ecd593d2cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5" returned: 0 in 0.494s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4c162-923c-4771-97e7-ecd593d2cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-266613235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83f34da-23a7-40e9-ae6c-a6385aa1ecba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e3e5ebe8044d92a179dcb41b8c1555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:00Z,use_quota=True,user_id='c4ca3827d6b749c39fe9191c0fb8f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:00 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 1G Sep 01 11:25:00 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f864618f-cd28-4da2-be3c-f01a489a4af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f864618f-cd28-4da2-be3c-f01a489a4af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c146c9e-23b0-45dc-a305-72bcc6e2ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c146c9e-23b0-45dc-a305-72bcc6e2ae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83f34da-23a7-40e9-ae6c-a6385aa1ecba', 'volume_name': 'volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca89f09-87c2-4c71-a40f-f9942b906b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca89f09-87c2-4c71-a40f-f9942b906b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15dba3e3-461e-440c-a560-4c00c80ce8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:00 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Volume e83f34da-23a7-40e9-ae6c-a6385aa1ecba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba', 'volume_size': 1} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:00 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 1G" returned: 0 in 0.479s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92776ab9-c760-492d-9d82-432add5f4fc5 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:00 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92776ab9-c760-492d-9d82-432add5f4fc5 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 Sep 01 11:25:00 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:00 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92776ab9-c760-492d-9d82-432add5f4fc5 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:00 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:25:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:00 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 Sep 01 11:25:00 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:01 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:01 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info Sep 01 11:25:01 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:01 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:01 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:01 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info Sep 01 11:25:01 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:01 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.info" returned: 0 in 0.256s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-266613235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83f34da-23a7-40e9-ae6c-a6385aa1ecba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e3e5ebe8044d92a179dcb41b8c1555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:00Z,use_quota=True,user_id='c4ca3827d6b749c39fe9191c0fb8f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Creating volume e83f34da-23a7-40e9-ae6c-a6385aa1ecba {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:01 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:01 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba 1073741824 Sep 01 11:25:01 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6ea5691f-cbcd-450a-a176-3c3e81f58ea8 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 9bceda3d-74ad-4373-86f8-970050681733: created successfully Sep 01 11:25:02 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba 1073741824" returned: 0 in 0.408s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:02 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba Sep 01 11:25:02 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:02 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba" returned: 0 in 0.328s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15dba3e3-461e-440c-a560-4c00c80ce8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea64d25b-5d4d-46c3-9ea0-07626b817a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:02 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Volume volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba (e83f34da-23a7-40e9-ae6c-a6385aa1ecba): created successfully Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea64d25b-5d4d-46c3-9ea0-07626b817a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Flow 'volume_create_manager' (6ab0ba1e-adda-4fc1-9e59-8c23d662ed62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d17324d5-481b-4e9a-8573-9a551ce98a9d tempest-AttachVolumeShelveTestJSON-1098605733 None] Created volume successfully. Sep 01 11:25:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 9bceda3d-74ad-4373-86f8-970050681733: deleting Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 9bceda3d-74ad-4373-86f8-970050681733: deleting {{(pid=87144) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-22878aae-5230-4690-9f36-8ebbc7014694" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-22878aae-5230-4690-9f36-8ebbc7014694" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-53233b92-0da3-42b5-b8b0-290c1857becb" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-53233b92-0da3-42b5-b8b0-290c1857becb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Deleting offline snapshot 53233b92-0da3-42b5-b8b0-290c1857becb of volume 22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] snapshot_file for this snap is: volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b1ff78-0f50-435b-bdd1-21c7dc4883cc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:02 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb Sep 01 11:25:02 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:03 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb" returned: 0 in 0.452s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22878aae-5230-4690-9f36-8ebbc7014694(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a4bf5-a9c0-42be-a697-c4a2493c451a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:03 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 Sep 01 11:25:03 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:03 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694" returned: 0 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:03 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb Sep 01 11:25:03 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:04 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb" returned: 0 in 0.469s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:04 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb Sep 01 11:25:04 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:04 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694.53233b92-0da3-42b5-b8b0-290c1857becb" returned: 0 in 0.272s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-53233b92-0da3-42b5-b8b0-290c1857becb" released by "_delete_snapshot" :: held 1.721s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-22878aae-5230-4690-9f36-8ebbc7014694" released by "delete_snapshot" :: held 1.750s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-92776ab9-c760-492d-9d82-432add5f4fc5" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-92776ab9-c760-492d-9d82-432add5f4fc5" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-da5979ca-8dd5-4f9b-a912-e78e5a70df89" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:04 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:25:04 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-da5979ca-8dd5-4f9b-a912-e78e5a70df89" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Deleting offline snapshot da5979ca-8dd5-4f9b-a912-e78e5a70df89 of volume 92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] snapshot_file for this snap is: volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac3833-f865-4c42-8213-77fec05b0e34]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:04 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 Sep 01 11:25:04 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:04 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.362s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 8 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:25:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:25:05 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89" returned: 0 in 0.488s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92776ab9-c760-492d-9d82-432add5f4fc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7173e94-e173-4071-8625-fbb42549655c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:05 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 Sep 01 11:25:05 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:05 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5" returned: 0 in 0.386s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:05 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 Sep 01 11:25:05 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:05 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:05 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89 Sep 01 11:25:05 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:06 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5.da5979ca-8dd5-4f9b-a912-e78e5a70df89" returned: 0 in 0.310s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-da5979ca-8dd5-4f9b-a912-e78e5a70df89" released by "_delete_snapshot" :: held 1.705s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-92776ab9-c760-492d-9d82-432add5f4fc5" released by "delete_snapshot" :: held 1.741s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:06 devstack cinder-volume[87144]: WARNING cinder.quota [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-892126467 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-892126467, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:06 devstack cinder-volume[87144]: WARNING cinder.quota [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-892126467 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-892126467, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['d5806d26-8e1e-4230-9a29-76b1962996a4', 'bf275e1b-1417-4052-a7c1-2d09144c2df5', '85d1b5a1-1233-430f-8499-5064e403c0ee', '6282084b-3ba9-4749-b2bd-3b2398466bec'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['3d342898-be89-4693-a275-1e920601338b', '341cf363-a075-40c6-a067-4977d4505c92', '98b96538-2582-4ee9-8e35-7f561f5a07ac', 'cea6b80e-67de-42e6-ad44-8e1e356bd941'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b78ef8c8-a7f4-4d4b-a997-800dcffa1ec8 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 9bceda3d-74ad-4373-86f8-970050681733: deleted successfully Sep 01 11:25:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c28c9a08-4f5c-44f6-ab07-fe0cd999d9b9 tempest-BackendsCapabilitiesAdminTestsJSON-167358129 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.923038482666, 'free_capacity_gb': 1773.923038482666, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87144) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 11:25:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0f7b8746-50e0-4a57-8919-9c2b9be532cb tempest-BackendsCapabilitiesAdminTestsJSON-167358129 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.923038482666, 'free_capacity_gb': 1773.923038482666, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87144) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 11:25:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-22878aae-5230-4690-9f36-8ebbc7014694" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-22878aae-5230-4690-9f36-8ebbc7014694" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2adaa65-8fc6-4cdf-9237-d9e15b2be42e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:08 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 Sep 01 11:25:08 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:08 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694" returned: 0 in 0.492s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:08 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694 Sep 01 11:25:08 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:08 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22878aae-5230-4690-9f36-8ebbc7014694" returned: 0 in 0.362s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-22878aae-5230-4690-9f36-8ebbc7014694" released by "delete_volume" :: held 0.954s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-92776ab9-c760-492d-9d82-432add5f4fc5" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-92776ab9-c760-492d-9d82-432add5f4fc5" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0547c-803d-4cb6-9860-6824501bece6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:09 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 Sep 01 11:25:09 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:09 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5" returned: 0 in 0.544s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:09 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5 Sep 01 11:25:09 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:09 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-92776ab9-c760-492d-9d82-432add5f4fc5" returned: 0 in 0.280s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-92776ab9-c760-492d-9d82-432add5f4fc5" released by "delete_volume" :: held 0.930s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:09 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['9a7d6fc6-afb0-440b-92a0-b1c30e6a650f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:09 devstack cinder-volume[87144]: WARNING cinder.quota [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-892126467 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-892126467, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:09 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['8cd2ec97-7d83-457d-aaaf-c19d61098936', '1da9d70c-d69a-42db-bc6c-ad88619f8675', '67f41bed-206c-4bf1-8119-7e91c29ac484', '7ed2cf81-cfa7-4340-a2eb-a84fd27ae95f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['0947ce73-8689-4679-a52b-dd82751d6c87', '27b11178-c0b9-4567-b270-fcc13482eb34', '7e3daa2f-a02b-4ed3-ae56-e617d6bd37e5', '34b84791-3dd5-4d21-af49-bf9a7a0f290e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:10 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:25:10 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:10 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.336s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:25:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-44a53ff6-4fc5-454c-9876-b420f647abf6 tempest-GroupSnapshotsTest-362684245 None] Delete group completed successfully. Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b468f05-f187-496d-a262-6148e5c8c4f6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:10 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 Sep 01 11:25:10 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-86c65aed-97ed-4481-89ee-471771b9fcaf tempest-GroupSnapshotsTest-362684245 None] Group tempest-GroupSnapshotsTest-Group-423571334: creating Sep 01 11:25:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-86c65aed-97ed-4481-89ee-471771b9fcaf tempest-GroupSnapshotsTest-362684245 None] Group tempest-GroupSnapshotsTest-Group-423571334: created successfully Sep 01 11:25:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-86c65aed-97ed-4481-89ee-471771b9fcaf tempest-GroupSnapshotsTest-362684245 None] Create group completed successfully. Sep 01 11:25:11 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936" returned: 0 in 0.561s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.585s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-b2f386ed-de92-4d46-bfd6-b28f3853a936', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1868d94b-f9c8-47e9-93fb-5cd158f86574', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:25:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-2899bf2c-4cb7-4b07-b522-74b1ab5fc192 req-fd699ba2-8f7b-4ba1-8a94-f52e9acf5a5f tempest-ServerActionsTestOtherA-233561984 None] attachment_update completed successfully. Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (22c6546e-beae-4ad4-af01-d5db03ff533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32593c41-401c-4199-836c-f6d597c8bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32593c41-401c-4199-836c-f6d597c8bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-87874351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=889f2763-6f1e-4c7c-a870-dcc2623df06e,host='devstack@QuobyteHD#QuobyteHD',id=923ad605-46fc-4219-aa24-2f75ef814168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:13Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e9c7710-fea9-4f3f-9262-7a7654f4c0da),volume_type_id=2e9c7710-fea9-4f3f-9262-7a7654f4c0da)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0f383c-36a2-4ec2-8cd1-2039a7dabf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0f383c-36a2-4ec2-8cd1-2039a7dabf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a626cd6b-8514-4a64-9399-0fa6972925a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a626cd6b-8514-4a64-9399-0fa6972925a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923ad605-46fc-4219-aa24-2f75ef814168', 'volume_name': 'volume-923ad605-46fc-4219-aa24-2f75ef814168', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1739d69a-d16d-457a-8492-a8fdd23c913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1739d69a-d16d-457a-8492-a8fdd23c913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69d7631-3493-49c4-851f-e55db92d7a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:13 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Volume 923ad605-46fc-4219-aa24-2f75ef814168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923ad605-46fc-4219-aa24-2f75ef814168', 'volume_size': 1} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=889f2763-6f1e-4c7c-a870-dcc2623df06e,created_at=2026-09-01T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-87874351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=889f2763-6f1e-4c7c-a870-dcc2623df06e,host='devstack@QuobyteHD#QuobyteHD',id=923ad605-46fc-4219-aa24-2f75ef814168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bdf802526642649dbd6d7a562d2941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:13Z,use_quota=True,user_id='8f5ae844320445688bd3d80b2369a83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e9c7710-fea9-4f3f-9262-7a7654f4c0da),volume_type_id=2e9c7710-fea9-4f3f-9262-7a7654f4c0da)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Creating volume 923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:13 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:13 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 1073741824 Sep 01 11:25:13 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:13 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 1073741824" returned: 0 in 0.561s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:13 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 Sep 01 11:25:13 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:14 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168" returned: 0 in 0.369s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69d7631-3493-49c4-851f-e55db92d7a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923ad605-46fc-4219-aa24-2f75ef814168', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b440ff-c7ac-42c9-94a7-b46567baec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:14 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Volume volume-923ad605-46fc-4219-aa24-2f75ef814168 (923ad605-46fc-4219-aa24-2f75ef814168): created successfully Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b440ff-c7ac-42c9-94a7-b46567baec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Flow 'volume_create_manager' (22c6546e-beae-4ad4-af01-d5db03ff533d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:14 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e362f3a1-68c3-4ae7-9e26-34b2e86828c8 tempest-GroupSnapshotsTest-362684245 None] Created volume successfully. Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-2935a1be-210c-4549-9cef-4497ee5e2661 req-97127132-9cd5-4370-8a0a-e9e8d75e1e2c tempest-AttachVolumeShelveTestJSON-1098605733 None] No connector for attachment 1effcebb-e601-4c5e-8e69-afa98c9dd9dd; skipping storage backend terminate_connection call. {{(pid=87144) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 11:25:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-2935a1be-210c-4549-9cef-4497ee5e2661 req-97127132-9cd5-4370-8a0a-e9e8d75e1e2c tempest-AttachVolumeShelveTestJSON-1098605733 None] Deleting attachment 1effcebb-e601-4c5e-8e69-afa98c9dd9dd. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:25:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-6db7f15f-5cab-4027-9a5a-f6a53017d816 tempest-ServerActionsTestOtherA-233561984 None] Terminate volume connection completed successfully. Sep 01 11:25:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-6db7f15f-5cab-4027-9a5a-f6a53017d816 tempest-ServerActionsTestOtherA-233561984 None] Deleting attachment 1868d94b-f9c8-47e9-93fb-5cd158f86574. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:25:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] GroupSnapshot 3eb9cb1a-2234-4366-a264-59c6703b6154: creating. Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Group snapshot 3eb9cb1a-2234-4366-a264-59c6703b6154: creating. {{(pid=87144) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Creating offline snapshot 2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 of volume 923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7821e0-c4a1-4286-a6f1-307e6ba7e64f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:16 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 Sep 01 11:25:16 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:16 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168" returned: 0 in 0.442s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:16 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 1G Sep 01 11:25:16 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:17 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 1G" returned: 0 in 0.605s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-923ad605-46fc-4219-aa24-2f75ef814168 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:17 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-923ad605-46fc-4219-aa24-2f75ef814168 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 Sep 01 11:25:17 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:17 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-923ad605-46fc-4219-aa24-2f75ef814168 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" returned: 0 in 0.365s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:17 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:25:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:17 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 Sep 01 11:25:17 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:18 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:18 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info Sep 01 11:25:18 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:18 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:18 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:18 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info Sep 01 11:25:18 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:18 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.info" returned: 0 in 0.332s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.447s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d48d15-a87f-4c05-b41a-7dc4afdb804a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-43fa33f4-3c15-48c3-81d1-23bc74486c72 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 3eb9cb1a-2234-4366-a264-59c6703b6154: created successfully Sep 01 11:25:18 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 Sep 01 11:25:18 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:19 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936" returned: 0 in 0.476s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.510s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-b2f386ed-de92-4d46-bfd6-b28f3853a936', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '790bdac7-315c-4a94-b772-7d27cebe1d64', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:25:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-850a6c24-2dde-4dbf-9c97-847a1bd35f96 req-87b342b5-1f6b-4e35-baec-67faab344152 tempest-ServerActionsTestOtherA-233561984 None] attachment_update completed successfully. Sep 01 11:25:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 3eb9cb1a-2234-4366-a264-59c6703b6154: deleting Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 3eb9cb1a-2234-4366-a264-59c6703b6154: deleting {{(pid=87144) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-923ad605-46fc-4219-aa24-2f75ef814168" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-923ad605-46fc-4219-aa24-2f75ef814168" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Deleting offline snapshot 2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 of volume 923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] snapshot_file for this snap is: volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ddf309-c8c8-4c12-b21a-cc260e3c1772]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:20 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 Sep 01 11:25:20 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:20 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" returned: 0 in 0.675s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-923ad605-46fc-4219-aa24-2f75ef814168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc2bd6-16f4-4be1-8b20-5f0280998b2e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:20 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 Sep 01 11:25:20 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:21 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168" returned: 0 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:21 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 Sep 01 11:25:21 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:21 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" returned: 0 in 0.750s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:21 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5 Sep 01 11:25:21 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:22 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-51181020-a33e-4803-b8d0-be551c7455dc tempest-GroupsTest-801426410 None] Group tempest-Group1-495147547: creating Sep 01 11:25:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168.2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" returned: 0 in 0.529s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-2ff71917-28b8-4e37-b3c6-32bbbf5e21e5" released by "_delete_snapshot" :: held 2.669s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-923ad605-46fc-4219-aa24-2f75ef814168" released by "delete_snapshot" :: held 2.724s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-51181020-a33e-4803-b8d0-be551c7455dc tempest-GroupsTest-801426410 None] Group tempest-Group1-495147547: created successfully Sep 01 11:25:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-51181020-a33e-4803-b8d0-be551c7455dc tempest-GroupsTest-801426410 None] Create group completed successfully. Sep 01 11:25:22 devstack cinder-volume[87144]: WARNING cinder.quota [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-533349489 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-533349489, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:22 devstack cinder-volume[87144]: WARNING cinder.quota [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-533349489 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-533349489, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:22 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['86cf3661-c4ab-4cb0-b81a-5562f50cb83c', '1f25f4da-a0ae-4309-9a38-1890bbd55228', '5776b2d8-86a8-4651-a743-0100d51e7624', 'df9bb556-4725-4493-b983-5325cd321dac'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-640d00ec-f2fc-405e-9b3a-4d775ddb89e5 tempest-GroupSnapshotsTest-362684245 None] group_snapshot 3eb9cb1a-2234-4366-a264-59c6703b6154: deleted successfully Sep 01 11:25:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "cinder-quobyte-923ad605-46fc-4219-aa24-2f75ef814168" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-923ad605-46fc-4219-aa24-2f75ef814168" acquired by "delete_volume" :: waited 0.058s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d6fde-a673-4e3d-ba7e-588e7f45efc3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-387fdf6d-2ac0-412b-abe6-df2c6441129e tempest-GroupsTest-801426410 None] Group tempest-Group2-643410168: creating Sep 01 11:25:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-387fdf6d-2ac0-412b-abe6-df2c6441129e tempest-GroupsTest-801426410 None] Group tempest-Group2-643410168: created successfully Sep 01 11:25:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-387fdf6d-2ac0-412b-abe6-df2c6441129e tempest-GroupsTest-801426410 None] Create group completed successfully. Sep 01 11:25:24 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 Sep 01 11:25:24 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:24 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168" returned: 0 in 0.587s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:24 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168 Sep 01 11:25:24 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:24 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-923ad605-46fc-4219-aa24-2f75ef814168" returned: 0 in 0.345s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Lock "cinder-quobyte-923ad605-46fc-4219-aa24-2f75ef814168" released by "delete_volume" :: held 1.103s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['06b5f5dc-a79f-420c-8a23-5b1aa183f5a8'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:25 devstack cinder-volume[87144]: WARNING cinder.quota [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-533349489 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-533349489, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Created reservations ['eb32a94d-14a7-4e68-87eb-d0be473807d1', 'edd0941c-8387-4fee-ba99-91de8f024063', '0aee34bb-9c9b-42eb-a0f2-7e222498c159', '468f2bfe-fcb6-417f-a0ef-21e686237eb6'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:25 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:25:25 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:25 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.366s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:25 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:25:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3743005d-068f-4add-829d-37481531c9e3 tempest-GroupSnapshotsTest-362684245 None] Delete group completed successfully. Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Flow 'volume_create_manager' (556c892d-b6d3-4f94-b565-d1c887a3a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f08df4-3d17-4f6c-bb55-5eed22e47e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f08df4-3d17-4f6c-bb55-5eed22e47e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255195217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8c9334a-e089-420b-952d-9a105b1ed3b5,host='devstack@QuobyteHD#QuobyteHD',id=4becc8a1-4d01-4eed-8193-9e6a14e92f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e877bf96bf54fde8cd7461e6ce8700e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:26Z,use_quota=True,user_id='9bcce4f58cd6458aa76546628432c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a5cf531-4ae6-46ed-8bae-c45a0fde5ea9),volume_type_id=0a5cf531-4ae6-46ed-8bae-c45a0fde5ea9)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8c7178-63d4-4657-8b95-24bbe56d8cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8c7178-63d4-4657-8b95-24bbe56d8cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0993e45-26a8-4001-9d5a-83f2d0815aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0993e45-26a8-4001-9d5a-83f2d0815aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4becc8a1-4d01-4eed-8193-9e6a14e92f16', 'volume_name': 'volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4175747-163d-429a-aafb-db520e72189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4175747-163d-429a-aafb-db520e72189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c184b8e2-c3ca-4096-ad24-e7b4ed45518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:26 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Volume 4becc8a1-4d01-4eed-8193-9e6a14e92f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16', 'volume_size': 1} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8c9334a-e089-420b-952d-9a105b1ed3b5,created_at=2026-09-01T09:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255195217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8c9334a-e089-420b-952d-9a105b1ed3b5,host='devstack@QuobyteHD#QuobyteHD',id=4becc8a1-4d01-4eed-8193-9e6a14e92f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e877bf96bf54fde8cd7461e6ce8700e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:26Z,use_quota=True,user_id='9bcce4f58cd6458aa76546628432c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a5cf531-4ae6-46ed-8bae-c45a0fde5ea9),volume_type_id=0a5cf531-4ae6-46ed-8bae-c45a0fde5ea9)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Creating volume 4becc8a1-4d01-4eed-8193-9e6a14e92f16 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:26 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:26 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 1073741824 Sep 01 11:25:26 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:26 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 1073741824" returned: 0 in 0.674s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:27 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 Sep 01 11:25:27 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16" returned: 0 in 0.468s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:27 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c184b8e2-c3ca-4096-ad24-e7b4ed45518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1134dfd-a999-493c-8ad1-a08214e18371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:27 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Volume volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 (4becc8a1-4d01-4eed-8193-9e6a14e92f16): created successfully Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1134dfd-a999-493c-8ad1-a08214e18371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Flow 'volume_create_manager' (556c892d-b6d3-4f94-b565-d1c887a3a888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9b35cb07-5e78-4663-a63b-35b321bc0d4f tempest-GroupsTest-801426410 None] Created volume successfully. Sep 01 11:25:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Acquiring lock "cinder-quobyte-4becc8a1-4d01-4eed-8193-9e6a14e92f16" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Lock "cinder-quobyte-4becc8a1-4d01-4eed-8193-9e6a14e92f16" acquired by "delete_volume" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0fd9a9-da8f-4e99-9138-e459c2e4b62c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:30 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 Sep 01 11:25:30 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:30 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16" returned: 0 in 0.906s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:30 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16 Sep 01 11:25:30 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:31 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4becc8a1-4d01-4eed-8193-9e6a14e92f16" returned: 0 in 0.561s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Lock "cinder-quobyte-4becc8a1-4d01-4eed-8193-9e6a14e92f16" released by "delete_volume" :: held 1.720s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:31 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Created reservations ['ec7360f6-978b-474e-bd3e-f99e1f854d5c'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:31 devstack cinder-volume[87144]: WARNING cinder.quota [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1888634949 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1888634949, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:31 devstack cinder-volume[87144]: WARNING cinder.quota [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1888634949 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1888634949, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Created reservations ['b3435be4-11aa-47b5-b794-619744297226', '0be40064-69c6-43c4-b972-9e48f9f121be', '728d1dda-fca0-4dab-a011-b04d5f36ee05', '209a4c63-21df-4912-ba4a-8debc23d6c05'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:32 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:25:32 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:33 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Created reservations ['a0df0892-e33f-4c54-b497-f47b92d200c7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.677s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:25:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7959e3be-3989-481d-aded-e26f9190ecd6 tempest-GroupsTest-801426410 None] Delete group completed successfully. Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:33 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:25:33 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:33 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.318s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:33 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:25:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6d9dd484-af2e-4d19-8ba1-367de5fea29c tempest-GroupsTest-801426410 None] Delete group completed successfully. Sep 01 11:25:34 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a17746da-207d-487c-946b-01d8b1a2b0df tempest-GroupsTest-801426410 None] Group tempest-GroupsTest-Group-897999415: creating Sep 01 11:25:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a17746da-207d-487c-946b-01d8b1a2b0df tempest-GroupsTest-801426410 None] Group tempest-GroupsTest-Group-897999415: created successfully Sep 01 11:25:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a17746da-207d-487c-946b-01d8b1a2b0df tempest-GroupsTest-801426410 None] Create group completed successfully. Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Flow 'volume_create_manager' (44f405da-1acf-4abe-a088-0fd3dcf10514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5d12f2-444c-4409-b500-a04625ca6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5d12f2-444c-4409-b500-a04625ca6407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990009394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bac11de3-a411-41ed-945e-dd93181852cd,host='devstack@QuobyteHD#QuobyteHD',id=a3ee2440-7a13-4417-a863-9017a2684259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e877bf96bf54fde8cd7461e6ce8700e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:37Z,use_quota=True,user_id='9bcce4f58cd6458aa76546628432c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a81829a-e677-45b8-b93c-3444294a8f3c),volume_type_id=8a81829a-e677-45b8-b93c-3444294a8f3c)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aec90fa-2b3d-47a3-aeff-5a1a6497f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aec90fa-2b3d-47a3-aeff-5a1a6497f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e6b1a1-f64e-4708-ac2d-24058a61f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e6b1a1-f64e-4708-ac2d-24058a61f611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ee2440-7a13-4417-a863-9017a2684259', 'volume_name': 'volume-a3ee2440-7a13-4417-a863-9017a2684259', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0db4c4-248b-4b60-b308-386215d26a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0db4c4-248b-4b60-b308-386215d26a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17355ddc-a67d-4dd4-a165-75c1ab50323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Volume a3ee2440-7a13-4417-a863-9017a2684259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ee2440-7a13-4417-a863-9017a2684259', 'volume_size': 1} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bac11de3-a411-41ed-945e-dd93181852cd,created_at=2026-09-01T09:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990009394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bac11de3-a411-41ed-945e-dd93181852cd,host='devstack@QuobyteHD#QuobyteHD',id=a3ee2440-7a13-4417-a863-9017a2684259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e877bf96bf54fde8cd7461e6ce8700e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:37Z,use_quota=True,user_id='9bcce4f58cd6458aa76546628432c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a81829a-e677-45b8-b93c-3444294a8f3c),volume_type_id=8a81829a-e677-45b8-b93c-3444294a8f3c)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Creating volume a3ee2440-7a13-4417-a863-9017a2684259 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:36 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:36 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 1073741824 Sep 01 11:25:36 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:37 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 1073741824" returned: 0 in 0.551s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:37 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 Sep 01 11:25:37 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:37 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17355ddc-a67d-4dd4-a165-75c1ab50323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ee2440-7a13-4417-a863-9017a2684259', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41d0cab-c0c2-4697-97cb-0818d2fed298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Volume volume-a3ee2440-7a13-4417-a863-9017a2684259 (a3ee2440-7a13-4417-a863-9017a2684259): created successfully Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41d0cab-c0c2-4697-97cb-0818d2fed298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Flow 'volume_create_manager' (44f405da-1acf-4abe-a088-0fd3dcf10514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-24283b7e-78a3-4373-9194-cc5793044063 tempest-GroupsTest-801426410 None] Created volume successfully. Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Flow 'volume_create_manager' (f4ca0f75-81fc-4307-9159-027e0f91e478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d1091d-94b0-4c17-b139-28439259d266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d1091d-94b0-4c17-b139-28439259d266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1126088407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bac11de3-a411-41ed-945e-dd93181852cd,host='devstack@QuobyteHD#QuobyteHD',id=03afcac4-0524-43cb-a0be-2f50160900c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e877bf96bf54fde8cd7461e6ce8700e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:39Z,use_quota=True,user_id='9bcce4f58cd6458aa76546628432c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a81829a-e677-45b8-b93c-3444294a8f3c),volume_type_id=8a81829a-e677-45b8-b93c-3444294a8f3c)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a200fc-9584-46f1-8e32-9d75728e31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a200fc-9584-46f1-8e32-9d75728e31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9730ed-6f9c-484e-a276-b3c5e147906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9730ed-6f9c-484e-a276-b3c5e147906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03afcac4-0524-43cb-a0be-2f50160900c8', 'volume_name': 'volume-03afcac4-0524-43cb-a0be-2f50160900c8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1c670f-1795-42b3-a27e-f9a76712c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1c670f-1795-42b3-a27e-f9a76712c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348984a5-3194-4e62-88ee-5b959ad67e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:39 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Volume 03afcac4-0524-43cb-a0be-2f50160900c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03afcac4-0524-43cb-a0be-2f50160900c8', 'volume_size': 1} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bac11de3-a411-41ed-945e-dd93181852cd,created_at=2026-09-01T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1126088407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bac11de3-a411-41ed-945e-dd93181852cd,host='devstack@QuobyteHD#QuobyteHD',id=03afcac4-0524-43cb-a0be-2f50160900c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e877bf96bf54fde8cd7461e6ce8700e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:39Z,use_quota=True,user_id='9bcce4f58cd6458aa76546628432c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a81829a-e677-45b8-b93c-3444294a8f3c),volume_type_id=8a81829a-e677-45b8-b93c-3444294a8f3c)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Creating volume 03afcac4-0524-43cb-a0be-2f50160900c8 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:39 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:39 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 1073741824 Sep 01 11:25:39 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:39 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 1073741824" returned: 0 in 0.482s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:39 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 Sep 01 11:25:39 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:40 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8" returned: 0 in 0.313s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348984a5-3194-4e62-88ee-5b959ad67e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03afcac4-0524-43cb-a0be-2f50160900c8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a652d4dd-7dae-4a6f-8593-271e89d17ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Volume volume-03afcac4-0524-43cb-a0be-2f50160900c8 (03afcac4-0524-43cb-a0be-2f50160900c8): created successfully Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a652d4dd-7dae-4a6f-8593-271e89d17ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Flow 'volume_create_manager' (f4ca0f75-81fc-4307-9159-027e0f91e478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-cbe0ec3a-914b-49f0-b5ff-8ab7fc434c7f tempest-GroupsTest-801426410 None] Created volume successfully. Sep 01 11:25:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-828d0a31-c322-4aa1-897e-7badc09a6cb4 tempest-GroupsTest-801426410 None] Update group completed successfully. Sep 01 11:25:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9dbc12ae-604f-4aa6-afbd-5f75dafe68ea tempest-GroupsTest-801426410 None] Update group completed successfully. Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Flow 'volume_create_manager' (cb3f5b2d-c83f-44a3-8ad4-616444633354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fa3182-c033-491d-b615-fa0ee0b1b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fa3182-c033-491d-b615-fa0ee0b1b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-11092661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb5233f-6540-45d6-9264-ea9f7ba57ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5bebb51b244bd5a9a030681a36cec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:43Z,use_quota=True,user_id='ba3263e4884547599e3b52a3454ee1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5715dd8f-853a-42d6-9681-172d078a685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5715dd8f-853a-42d6-9681-172d078a685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c7eb77-e77f-4a42-a18b-4302bfc6181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c7eb77-e77f-4a42-a18b-4302bfc6181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb5233f-6540-45d6-9264-ea9f7ba57ed9', 'volume_name': 'volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fac56f-97cb-498b-a304-bc5f5513af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fac56f-97cb-498b-a304-bc5f5513af42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268f93c2-c9d4-4431-bbf4-efe356ace107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9', 'volume_size': 1} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-11092661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb5233f-6540-45d6-9264-ea9f7ba57ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5bebb51b244bd5a9a030681a36cec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:43Z,use_quota=True,user_id='ba3263e4884547599e3b52a3454ee1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Creating volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:42 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:42 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 1073741824 Sep 01 11:25:42 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:43 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 1073741824" returned: 0 in 0.445s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:43 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 Sep 01 11:25:43 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:43 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" returned: 0 in 0.262s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268f93c2-c9d4-4431-bbf4-efe356ace107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abae4bd8-5198-4a6b-8efb-c67ccb2c836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Volume volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 (ecb5233f-6540-45d6-9264-ea9f7ba57ed9): created successfully Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abae4bd8-5198-4a6b-8efb-c67ccb2c836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Flow 'volume_create_manager' (cb3f5b2d-c83f-44a3-8ad4-616444633354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-90bf933a-fd23-4ecb-9955-fb242f5c58f2 tempest-SnapshotsActionsTest-1579292491 None] Created volume successfully. Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Acquiring lock "cinder-quobyte-03afcac4-0524-43cb-a0be-2f50160900c8" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Lock "cinder-quobyte-03afcac4-0524-43cb-a0be-2f50160900c8" acquired by "delete_volume" :: waited 0.052s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc56530e-951a-4a7e-a46c-bb6a17eaf2f3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Creating offline snapshot d77212ff-0343-4c79-add2-739c67fed0cd of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81bd6a9-6cbe-4289-95c6-fd96f24a33f6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:44 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 Sep 01 11:25:44 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:44 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 Sep 01 11:25:44 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:44 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8" returned: 0 in 0.422s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:44 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8 Sep 01 11:25:44 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:44 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" returned: 0 in 0.387s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:44 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd 1G Sep 01 11:25:44 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:44 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-03afcac4-0524-43cb-a0be-2f50160900c8" returned: 0 in 0.273s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Lock "cinder-quobyte-03afcac4-0524-43cb-a0be-2f50160900c8" released by "delete_volume" :: held 0.761s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Acquiring lock "cinder-quobyte-a3ee2440-7a13-4417-a863-9017a2684259" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Lock "cinder-quobyte-a3ee2440-7a13-4417-a863-9017a2684259" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[13785894-aaa5-4a31-bf31-1c2520b632cb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:44 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 Sep 01 11:25:44 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:44 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd 1G" returned: 0 in 0.460s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:44 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:25:44 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:45 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259" returned: 0 in 0.478s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:45 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259 Sep 01 11:25:45 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:45 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:45 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd is being set with open permissions: ugo+rw Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:45 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:25:45 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:45 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a3ee2440-7a13-4417-a863-9017a2684259" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Lock "cinder-quobyte-a3ee2440-7a13-4417-a863-9017a2684259" released by "delete_volume" :: held 0.780s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Created reservations ['d5b6fe35-a5bd-43bd-94bc-e0e45f0cb71d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:45 devstack cinder-volume[87144]: WARNING cinder.quota [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-994859336 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-994859336, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:45 devstack cinder-volume[87144]: WARNING cinder.quota [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-994859336 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-994859336, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:45 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.256s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Created reservations ['82b61d65-4c8c-4e64-baf5-d780d8253631', 'ab1987a1-dfaf-4182-86f1-0e1432704636', 'a85e81a6-81cd-4632-ba2f-795a09cf12b0', 'b013ee5f-fd38-44bc-a32e-9ad3b414dfe9'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:45 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info Sep 01 11:25:45 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Created reservations ['509c9ff6-2321-4603-8d78-21fc3d168293', 'dcd1510c-1a8d-4e0e-a3bb-6775402613fe', 'd25d9b93-eef0-4719-a3a1-eb39352f6262', 'bae72c5e-0aca-4891-adff-acefc4763a2e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:45 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:25:45 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:45 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info" returned: 0 in 0.305s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:45 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info is being set with open permissions: ugo+rw Sep 01 11:25:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:45 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info Sep 01 11:25:45 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:46 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.273s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:46 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:25:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-909986c2-076b-45fe-ac9e-d646873f236b tempest-GroupsTest-801426410 None] Delete group completed successfully. Sep 01 11:25:46 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.info" returned: 0 in 0.307s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d7c03ee1-d2cd-4720-bb43-7d9689d1937d tempest-SnapshotsActionsTest-1579292491 None] Create snapshot completed successfully Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=150,cinder:SELECT=146,cinder:INSERT=37,cinder:DELETE=5 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=145,cinder:SELECT=149,cinder:DELETE=7,cinder:INSERT=28 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Creating offline snapshot f894796f-05e4-4d69-8190-9ebf56314f8a of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e941b-3cad-44a0-b3bd-f0b3a1a51f54]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:48 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:25:48 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:48 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.387s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:48 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a 1G Sep 01 11:25:48 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:48 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a 1G" returned: 0 in 0.435s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:48 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a Sep 01 11:25:48 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:49 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a" returned: 0 in 0.299s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:49 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a is being set with open permissions: ugo+rw Sep 01 11:25:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:49 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a Sep 01 11:25:49 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:49 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a" returned: 0 in 0.237s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.490s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fb141df7-9dfc-4350-acd9-70143ab1d115 tempest-SnapshotsActionsTest-1579292491 None] Create snapshot completed successfully Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-f894796f-05e4-4d69-8190-9ebf56314f8a-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-f894796f-05e4-4d69-8190-9ebf56314f8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-f894796f-05e4-4d69-8190-9ebf56314f8a" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-f894796f-05e4-4d69-8190-9ebf56314f8a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Deleting offline snapshot f894796f-05e4-4d69-8190-9ebf56314f8a of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] snapshot_file for this snap is: volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ec9b2-99bb-43ee-9b20-2059a0d545fe]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:50 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a Sep 01 11:25:50 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:50 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[782e418f-b55e-40f3-946d-f02eee7b11bf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:50 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:25:50 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:50 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.366s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:50 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a Sep 01 11:25:50 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0304154b-3d09-411d-b340-b803900bcabc tempest-GroupsV314Test-1933444681 None] Group tempest-GroupsV314Test-Group-762845835: creating Sep 01 11:25:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0304154b-3d09-411d-b340-b803900bcabc tempest-GroupsV314Test-1933444681 None] Group tempest-GroupsV314Test-Group-762845835: created successfully Sep 01 11:25:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0304154b-3d09-411d-b340-b803900bcabc tempest-GroupsV314Test-1933444681 None] Create group completed successfully. Sep 01 11:25:51 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a" returned: 0 in 0.384s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:51 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a Sep 01 11:25:51 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:51 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.f894796f-05e4-4d69-8190-9ebf56314f8a" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-f894796f-05e4-4d69-8190-9ebf56314f8a" released by "_delete_snapshot" :: held 1.466s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" released by "delete_snapshot" :: held 1.487s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:51 devstack cinder-volume[87144]: WARNING cinder.quota [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Created reservations ['dac448ad-ce9f-4f52-a29e-3cf6c4de3573', '722f866a-8091-44f7-9297-3868f3a00c5b', 'cc428bee-c63d-48cd-9802-717bb645b706', '7d17b25c-a3b6-4546-a646-41b4be1fe061'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Delete snapshot completed successfully. Sep 01 11:25:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4cf68ac8-7830-42c4-afd1-53e76bd502e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-f894796f-05e4-4d69-8190-9ebf56314f8a-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Creating offline snapshot 5263225e-43f6-439f-9af9-42d48f97a6bc of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03fa3df-0308-4464-af4c-d8ae01275463]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:52 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:25:52 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Flow 'volume_create_manager' (ae0ab1ba-1b77-4342-be26-429f40e74aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671314a9-af6e-4b1e-8fe8-9a429e9f71c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671314a9-af6e-4b1e-8fe8-9a429e9f71c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835635875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18d64315-7568-4529-8bd7-1db7ed5ced91,host='devstack@QuobyteHD#QuobyteHD',id=cb8b9a43-41f0-4867-a748-28127e42f4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f3fd615014cb8a7fae03bb7421089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:53Z,use_quota=True,user_id='8f32287a438348f2ad877d5413546797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d6abda-3c98-49e7-87e6-9b6f9280bbed),volume_type_id=b8d6abda-3c98-49e7-87e6-9b6f9280bbed)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963a4c16-eb17-4ba8-acc8-a0fdf772c969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963a4c16-eb17-4ba8-acc8-a0fdf772c969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779ce06f-648b-428c-81e7-d044a183a8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779ce06f-648b-428c-81e7-d044a183a8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8b9a43-41f0-4867-a748-28127e42f4e0', 'volume_name': 'volume-cb8b9a43-41f0-4867-a748-28127e42f4e0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3207c99-9693-4c41-ab43-1d3e6f1bacd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3207c99-9693-4c41-ab43-1d3e6f1bacd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a754b8f6-6e18-4e03-93ab-12ccf7b8427e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:52 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Volume cb8b9a43-41f0-4867-a748-28127e42f4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8b9a43-41f0-4867-a748-28127e42f4e0', 'volume_size': 1} Sep 01 11:25:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:53 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.380s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:53 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc 1G Sep 01 11:25:53 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:53 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc 1G" returned: 0 in 0.395s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:53 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc Sep 01 11:25:53 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:53 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc" returned: 0 in 0.283s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:53 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc is being set with open permissions: ugo+rw Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:53 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc Sep 01 11:25:53 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:53 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc" returned: 0 in 0.245s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.408s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18d64315-7568-4529-8bd7-1db7ed5ced91,created_at=2026-09-01T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835635875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18d64315-7568-4529-8bd7-1db7ed5ced91,host='devstack@QuobyteHD#QuobyteHD',id=cb8b9a43-41f0-4867-a748-28127e42f4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f3fd615014cb8a7fae03bb7421089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:25:53Z,use_quota=True,user_id='8f32287a438348f2ad877d5413546797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d6abda-3c98-49e7-87e6-9b6f9280bbed),volume_type_id=b8d6abda-3c98-49e7-87e6-9b6f9280bbed)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Creating volume cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:25:53 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:25:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:54 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 1073741824 Sep 01 11:25:54 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:54 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c646e42b-4c7d-4080-8b34-038af1e0a1be tempest-SnapshotsActionsTest-1579292491 None] Create snapshot completed successfully Sep 01 11:25:54 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 1073741824" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:54 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:25:54 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:54 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.245s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a754b8f6-6e18-4e03-93ab-12ccf7b8427e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8b9a43-41f0-4867-a748-28127e42f4e0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd1ce48-a9e7-4044-9a9a-1604bf91b25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:25:54 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Volume volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 (cb8b9a43-41f0-4867-a748-28127e42f4e0): created successfully Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd1ce48-a9e7-4044-9a9a-1604bf91b25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Flow 'volume_create_manager' (ae0ab1ba-1b77-4342-be26-429f40e74aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:25:54 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f71fc39a-ab61-4761-8e0a-9a71c633816a tempest-GroupsV314Test-1933444681 None] Created volume successfully. Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-5263225e-43f6-439f-9af9-42d48f97a6bc-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-5263225e-43f6-439f-9af9-42d48f97a6bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-5263225e-43f6-439f-9af9-42d48f97a6bc" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-5263225e-43f6-439f-9af9-42d48f97a6bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Deleting offline snapshot 5263225e-43f6-439f-9af9-42d48f97a6bc of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] snapshot_file for this snap is: volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f10201-0852-4374-863e-30a8862582dd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:54 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc Sep 01 11:25:54 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:55 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[669195ef-cd93-4a32-8c78-51a247d65a96]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:55 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:25:55 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:55 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.366s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:55 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc Sep 01 11:25:55 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:55 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Cloning volume cb8b9a43-41f0-4867-a748-28127e42f4e0 to volume 9ba79077-6768-49c3-bb3c-0ee763ac02ea Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Creating offline snapshot 3bc9a588-9b8b-478b-9b3a-1ea169b487eb of volume cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[270eb3f9-50cd-428c-bd10-e588092cb5a9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:55 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:25:55 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:56 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc" returned: 0 in 0.419s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:56 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc Sep 01 11:25:56 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:56 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.388s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:56 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb 1G Sep 01 11:25:56 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:56 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.5263225e-43f6-439f-9af9-42d48f97a6bc" returned: 0 in 0.251s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-5263225e-43f6-439f-9af9-42d48f97a6bc" released by "_delete_snapshot" :: held 1.506s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" released by "delete_snapshot" :: held 1.530s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Created reservations ['47f148dc-e2c9-4123-9597-986cbeccc97e', '24184fc0-bc05-49c1-b5a7-f80dc80bf0c5', 'ffd99378-094e-4e6c-b1ba-0923e403b3c6', '377564a7-7e0e-446d-9870-7bac191a2c9b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:25:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Delete snapshot completed successfully. Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2c1886b3-9265-4631-8a5c-fa999e56d399 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-5263225e-43f6-439f-9af9-42d48f97a6bc-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:25:56 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb 1G" returned: 0 in 0.393s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:56 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb Sep 01 11:25:56 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:56 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:56 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:25:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:56 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb Sep 01 11:25:56 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:57 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:57 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info Sep 01 11:25:57 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:57 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:57 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:57 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info Sep 01 11:25:57 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:57 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.info" returned: 0 in 0.240s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Acquiring lock "cinder-quobyte-9ba79077-6768-49c3-bb3c-0ee763ac02ea" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-9ba79077-6768-49c3-bb3c-0ee763ac02ea" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] snapshot: 3bc9a588-9b8b-478b-9b3a-1ea169b487eb, volume: 9ba79077-6768-49c3-bb3c-0ee763ac02ea, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e527ad8-770b-4a67-977a-abd11407dd46]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:57 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb Sep 01 11:25:57 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:58 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb" returned: 0 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb8b9a43-41f0-4867-a748-28127e42f4e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef02cc6-1b46-47de-b3a4-b7cebb181377]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:58 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:25:58 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:25:58 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.365s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:25:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:25:58 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea Sep 01 11:25:58 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:02 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea" returned: 0 in 4.467s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b3f961-9943-4b25-aa8e-7ea751890449]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:03 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:26:03 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:03 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.564s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:26:03 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Converted 1024.00 MB image at 229.14 MB/s Sep 01 11:26:03 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:03 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea Sep 01 11:26:03 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:03 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-b6b3c9fb-80e1-42bc-9c43-6fe2c92a090e req-02bad5f4-4eb2-4017-9071-31b20e2bd5dd tempest-ServerActionsTestOtherA-233561984 None] Terminate volume connection completed successfully. Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-b6b3c9fb-80e1-42bc-9c43-6fe2c92a090e req-02bad5f4-4eb2-4017-9071-31b20e2bd5dd tempest-ServerActionsTestOtherA-233561984 None] Deleting attachment 790bdac7-315c-4a94-b772-7d27cebe1d64. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:26:03 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-9ba79077-6768-49c3-bb3c-0ee763ac02ea" released by "_copy_volume_from_snapshot" :: held 6.109s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Acquiring lock "cinder-quobyte-3bc9a588-9b8b-478b-9b3a-1ea169b487eb" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-3bc9a588-9b8b-478b-9b3a-1ea169b487eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Deleting offline snapshot 3bc9a588-9b8b-478b-9b3a-1ea169b487eb of volume cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] snapshot_file for this snap is: volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6428c22c-2722-4b18-a8d5-703f7937a7a9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:03 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb Sep 01 11:26:03 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:04 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb" returned: 0 in 0.364s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb8b9a43-41f0-4867-a748-28127e42f4e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad973242-429f-4b74-8ef9-9c74e8a8050a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:04 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:26:04 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:04 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:04 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:04 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:04 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb Sep 01 11:26:04 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:04 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.445s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 8 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:26:05 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb" returned: 0 in 0.525s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:05 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb Sep 01 11:26:05 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:05 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0.3bc9a588-9b8b-478b-9b3a-1ea169b487eb" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-3bc9a588-9b8b-478b-9b3a-1ea169b487eb" released by "_delete_snapshot" :: held 1.673s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.815s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.266s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Creating offline snapshot 25f1c1ea-bb90-49e0-8c24-3da6c007200f of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[053a20f6-fd8c-4425-918f-47438999b2b8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e1599254-1f06-4510-ba05-bb40b018e800 tempest-GroupsV314Test-1933444681 None] Create group from source-group-18d64315-7568-4529-8bd7-1db7ed5ced91 completed successfully. Sep 01 11:26:05 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:05 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:06 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.466s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:06 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f 1G Sep 01 11:26:06 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Acquiring lock "cinder-quobyte-9ba79077-6768-49c3-bb3c-0ee763ac02ea" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-9ba79077-6768-49c3-bb3c-0ee763ac02ea" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf4342-51c2-44a2-976e-4140470c608c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:06 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f 1G" returned: 0 in 0.504s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:06 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea Sep 01 11:26:06 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:06 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f Sep 01 11:26:06 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:06 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea" returned: 0 in 0.400s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:06 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f" returned: 0 in 0.318s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:06 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f is being set with open permissions: ugo+rw Sep 01 11:26:06 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea Sep 01 11:26:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:06 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:06 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f Sep 01 11:26:06 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:07 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ba79077-6768-49c3-bb3c-0ee763ac02ea" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-9ba79077-6768-49c3-bb3c-0ee763ac02ea" released by "delete_volume" :: held 0.713s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:07 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f" returned: 0 in 0.266s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8b3f7910-29bb-4722-92b9-e07bb1618ab7 tempest-SnapshotsActionsTest-1579292491 None] Create snapshot completed successfully Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Created reservations ['f306d70f-a9cd-4373-aa93-ef68435f2715'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:07 devstack cinder-volume[87144]: WARNING cinder.quota [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1673338254 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1673338254, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:26:07 devstack cinder-volume[87144]: WARNING cinder.quota [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1673338254 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1673338254, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Created reservations ['fd5f8f7d-a0b9-4ef4-ba9b-5d1ac2f47411', 'd535f5d3-3f07-46a3-a241-3acbfea184b4', '3d112c86-0d75-47b9-87a8-4797c1183c9a', '0a8d53ce-b2c6-4544-9d1c-f83b3075a6c5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:07 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:07 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:07 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4dafc736-c81d-4a35-9d92-4c34d44905c2 tempest-GroupsV314Test-1933444681 None] Delete group completed successfully. Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Acquiring lock "cinder-quobyte-cb8b9a43-41f0-4867-a748-28127e42f4e0" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-cb8b9a43-41f0-4867-a748-28127e42f4e0" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75375aa-33a3-4181-8a4f-9807be1ca84b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-25f1c1ea-bb90-49e0-8c24-3da6c007200f-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-25f1c1ea-bb90-49e0-8c24-3da6c007200f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:08 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:26:08 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-25f1c1ea-bb90-49e0-8c24-3da6c007200f" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-25f1c1ea-bb90-49e0-8c24-3da6c007200f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Deleting offline snapshot 25f1c1ea-bb90-49e0-8c24-3da6c007200f of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] snapshot_file for this snap is: volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1966560a-98ca-4ea0-bea1-d050c93aaa54]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:08 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f Sep 01 11:26:08 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:08 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.550s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:08 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0 Sep 01 11:26:08 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:08 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f" returned: 0 in 0.540s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ac900-3d2b-4b80-96e1-4b9e4e3df237]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:09 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:09 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:09 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb8b9a43-41f0-4867-a748-28127e42f4e0" returned: 0 in 0.524s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Lock "cinder-quobyte-cb8b9a43-41f0-4867-a748-28127e42f4e0" released by "delete_volume" :: held 1.168s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Created reservations ['1c23f133-3cd0-4780-9c09-443cd985d18d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Created reservations ['1888fd65-674d-489b-a5b8-45d064b114e8', 'f515ab66-8c0f-43c3-be36-bd33f38176e3', '4da2dae0-5dbe-4172-8f24-b4b26b132ef0', '8c2527ad-a52a-40c0-ac52-cbb15a87542f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:09 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:09 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:09 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.607s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:09 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f Sep 01 11:26:09 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:09 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:09 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9e40d1fe-0889-47dc-abe5-8bc6e6f209db tempest-GroupsV314Test-1933444681 None] Delete group completed successfully. Sep 01 11:26:10 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f" returned: 0 in 0.575s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:10 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f Sep 01 11:26:10 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:10 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.25f1c1ea-bb90-49e0-8c24-3da6c007200f" returned: 0 in 0.294s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-25f1c1ea-bb90-49e0-8c24-3da6c007200f" released by "_delete_snapshot" :: held 2.242s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" released by "delete_snapshot" :: held 2.271s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Created reservations ['626a6af4-87b9-4eff-90bd-da4c24e25cf7', 'a12766ce-ad8f-4f15-a5ac-94cb6edb4db7', '0d952a0d-5de6-47f7-b0d7-f1407cffcdd6', '66556745-83c6-4ed8-8994-dbe0cff64c75'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Flow 'volume_create_manager' (ab0b1880-2ad0-4a9f-91f2-df2f4ddbfac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47239a80-a05f-4a64-9903-11e3d2d8643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Delete snapshot completed successfully. Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47239a80-a05f-4a64-9903-11e3d2d8643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1230276734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bacf325-0862-4876-a396-133854c29e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52019a760fa4001b794756728bd6f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:11Z,use_quota=True,user_id='40d40c9315dc458eb4a1f7146dc34f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f0fd33-9a48-4712-b046-7164ab575e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f0fd33-9a48-4712-b046-7164ab575e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6fe369-876c-4615-a8c5-4ae5b710530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:26:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a887c42-9c6c-4c20-9b90-f778a57963e0 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-25f1c1ea-bb90-49e0-8c24-3da6c007200f-delete_snapshot" released by "delete_snapshot" :: held 2.568s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6fe369-876c-4615-a8c5-4ae5b710530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bacf325-0862-4876-a396-133854c29e10', 'volume_name': 'volume-6bacf325-0862-4876-a396-133854c29e10', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3dc36b-77b4-4456-a55d-20fd5a9811e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3dc36b-77b4-4456-a55d-20fd5a9811e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67094f99-66ae-4d1c-b445-bc6928a70a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:11 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Volume 6bacf325-0862-4876-a396-133854c29e10: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bacf325-0862-4876-a396-133854c29e10', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Trying to clone 6bacf325-0862-4876-a396-133854c29e10 from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:26:11 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Image download 20.69 MB at 20.69 MB/s Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf440208-78f3-4a2e-8fda-b77559860eb2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:11 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD Sep 01 11:26:11 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Creating offline snapshot 655b191d-8950-4883-8a18-88f1b824420a of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9903bb4e-fe9b-4fe1-b8ee-42b1eb9b61e0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:12 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:12 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:12 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b is fetched for user 40d40c9315dc458eb4a1f7146dc34f39. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3d1f9e-2be9-4d54-afa2-d56a6b73637e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:12 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD Sep 01 11:26:12 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:12 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.480s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:12 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a 1G Sep 01 11:26:12 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:12 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:13 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a 1G" returned: 0 in 0.570s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:13 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a Sep 01 11:26:13 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Acquiring lock "cinder-e83f34da-23a7-40e9-ae6c-a6385aa1ecba-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "cinder-e83f34da-23a7-40e9-ae6c-a6385aa1ecba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:13 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:13 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a is being set with open permissions: ugo+rw Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Acquiring lock "cinder-quobyte-e83f34da-23a7-40e9-ae6c-a6385aa1ecba" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:13 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a Sep 01 11:26:13 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "cinder-quobyte-e83f34da-23a7-40e9-ae6c-a6385aa1ecba" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b3426-ab9d-483e-8fe2-dfe2e5d791cd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:13 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba Sep 01 11:26:13 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:13 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a" returned: 0 in 0.299s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1230276734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bacf325-0862-4876-a396-133854c29e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52019a760fa4001b794756728bd6f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:11Z,use_quota=True,user_id='40d40c9315dc458eb4a1f7146dc34f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Creating volume 6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:13 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:13 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 1073741824 Sep 01 11:26:13 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-76d09ae4-a710-4334-8608-52c992209ed6 tempest-SnapshotsActionsTest-1579292491 None] Create snapshot completed successfully Sep 01 11:26:14 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba" returned: 0 in 0.443s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:14 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba Sep 01 11:26:14 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-655b191d-8950-4883-8a18-88f1b824420a-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-655b191d-8950-4883-8a18-88f1b824420a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Acquiring lock "cinder-quobyte-655b191d-8950-4883-8a18-88f1b824420a" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-655b191d-8950-4883-8a18-88f1b824420a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:14 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Deleting offline snapshot 655b191d-8950-4883-8a18-88f1b824420a of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] snapshot_file for this snap is: volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83f34da-23a7-40e9-ae6c-a6385aa1ecba" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dcc3d7-ba5c-4449-bc66-4d52bc6b12d9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "cinder-quobyte-e83f34da-23a7-40e9-ae6c-a6385aa1ecba" released by "delete_volume" :: held 0.796s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:14 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 1073741824" returned: 0 in 0.552s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Created reservations ['9fefb892-b801-4ebc-86a6-0771d307c81c', '292ede3c-b8a3-4da2-a356-8f34bba7c687', '3ae6e2af-b5df-4f77-8dea-334131659453', '5a71c169-c738-4383-b1c6-092315968966'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:14 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:14 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:14 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a Sep 01 11:26:14 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:14 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:14 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:14 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 0.358s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Attempting download of 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume 6bacf325-0862-4876-a396-133854c29e10. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:26:14 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a" returned: 0 in 0.523s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[494772bc-5add-4aea-b041-d27cc683ae64]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[947037f8-d034-45ea-b16d-2cc36bb9b8b7]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:14 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:14 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Deleted volume successfully. Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-55a34622-15d7-44c7-993c-44abf96ccc00 tempest-AttachVolumeShelveTestJSON-1098605733 None] Lock "cinder-e83f34da-23a7-40e9-ae6c-a6385aa1ecba-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:15 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw Sep 01 11:26:15 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:15 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:15 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:15 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw" returned: 0 in 0.394s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:15 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:15 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a Sep 01 11:26:15 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:15 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw Sep 01 11:26:15 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:15 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw" returned: 1 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_3qw5lnbw' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f5649-4560-460a-bfa1-c18cb69f0303]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:15 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD Sep 01 11:26:15 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:15 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a" returned: 0 in 0.540s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:15 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a Sep 01 11:26:15 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:16 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b was qcow2, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:16 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:16 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:16 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.655b191d-8950-4883-8a18-88f1b824420a" returned: 0 in 0.346s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-655b191d-8950-4883-8a18-88f1b824420a" released by "_delete_snapshot" :: held 1.994s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" released by "delete_snapshot" :: held 2.024s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Created reservations ['724754f7-3562-4225-b5b5-4adf61b6229a', '17c3265d-f6dd-418c-a38f-14fd420e4891', 'ac594c96-cb9a-4676-bb4e-4bf563bdd968', 'ff5c3f29-8282-493c-a46f-dc7965c5e8f8'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Delete snapshot completed successfully. Sep 01 11:26:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a596584e-02fa-43cd-8a0b-2f94fa81f494 tempest-SnapshotsActionsTest-346656841 None] Lock "cinder-655b191d-8950-4883-8a18-88f1b824420a-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Flow 'volume_create_manager' (57a38ce6-22d4-44a3-96f0-35a5a8e1c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a010589a-49d2-4fb4-b065-86d8c88005e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a010589a-49d2-4fb4-b065-86d8c88005e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-494029973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a242f5ec-4c78-45d9-80a5-48373fb59df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4344928550b40faa813b7261e6e3e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:18Z,use_quota=True,user_id='068f3921e4dc40f9be28bd4eb060859e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18c9057-f032-4ebd-97be-1ac1fe8672ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18c9057-f032-4ebd-97be-1ac1fe8672ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc2b55a-6ad5-404b-92dd-3909f8637982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc2b55a-6ad5-404b-92dd-3909f8637982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a242f5ec-4c78-45d9-80a5-48373fb59df9', 'volume_name': 'volume-a242f5ec-4c78-45d9-80a5-48373fb59df9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c27154-6b4e-4cb5-89b8-38e000e11aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c27154-6b4e-4cb5-89b8-38e000e11aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2a7c3a-6df0-44b9-85a6-f62f6d4d6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Volume a242f5ec-4c78-45d9-80a5-48373fb59df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a242f5ec-4c78-45d9-80a5-48373fb59df9', 'volume_size': 1} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-494029973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a242f5ec-4c78-45d9-80a5-48373fb59df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4344928550b40faa813b7261e6e3e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:18Z,use_quota=True,user_id='068f3921e4dc40f9be28bd4eb060859e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Creating volume a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:17 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:17 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 1073741824 Sep 01 11:26:17 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "cinder-d77212ff-0343-4c79-add2-739c67fed0cd-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-d77212ff-0343-4c79-add2-739c67fed0cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "cinder-quobyte-d77212ff-0343-4c79-add2-739c67fed0cd" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-quobyte-d77212ff-0343-4c79-add2-739c67fed0cd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Deleting offline snapshot d77212ff-0343-4c79-add2-739c67fed0cd of volume ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] snapshot_file for this snap is: volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516ad9e-5d8b-42ae-ae60-866ea82c604a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:18 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 1.981s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_l6jjfv68devstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:26:18 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Converted 112.00 MB image at 56.46 MB/s Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:18 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 1G Sep 01 11:26:18 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:18 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:18 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:18 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 1073741824" returned: 0 in 0.532s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:18 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 Sep 01 11:26:18 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:18 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 1G" returned: 0 in 0.308s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3e6c9-d0f4-4354-b144-3fe58879725b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:18 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.422s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[64738a1c-ab11-4bbb-8b88-cdfa3fc3d6f1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:18 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:18 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:18 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 Sep 01 11:26:18 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:18 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9" returned: 0 in 0.328s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2a7c3a-6df0-44b9-85a6-f62f6d4d6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a242f5ec-4c78-45d9-80a5-48373fb59df9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bda3c59-f7bb-46f5-a945-b60dfc60fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Volume volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 (a242f5ec-4c78-45d9-80a5-48373fb59df9): created successfully Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bda3c59-f7bb-46f5-a945-b60dfc60fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Flow 'volume_create_manager' (57a38ce6-22d4-44a3-96f0-35a5a8e1c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-420419b2-f133-43a6-94c2-eb7d21fcf114 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Created volume successfully. Sep 01 11:26:19 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 0.532s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:19 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" returned: 0 in 0.517s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:19 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:19 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:19 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:19 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:19 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 1 in 0.393s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Downloaded image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume 6bacf325-0862-4876-a396-133854c29e10 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b for user 40d40c9315dc458eb4a1f7146dc34f39 is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Marking volume 6bacf325-0862-4876-a396-133854c29e10 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Copying metadata from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b to 6bacf325-0862-4876-a396-133854c29e10. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Creating volume glance metadata for volume 6bacf325-0862-4876-a396-133854c29e10 backed by image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:26:19 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:19 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd Sep 01 11:26:19 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67094f99-66ae-4d1c-b445-bc6928a70a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bacf325-0862-4876-a396-133854c29e10', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216ab041-d179-4cee-8b21-6f85d4c1ed03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:19 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Volume volume-6bacf325-0862-4876-a396-133854c29e10 (6bacf325-0862-4876-a396-133854c29e10): created successfully Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216ab041-d179-4cee-8b21-6f85d4c1ed03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Flow 'volume_create_manager' (ab0b1880-2ad0-4a9f-91f2-df2f4ddbfac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-711f882e-da38-4231-9eee-42b94a18c1ac tempest-ServerActionsTestOtherA-233561984 None] Created volume successfully. Sep 01 11:26:19 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9.d77212ff-0343-4c79-add2-739c67fed0cd" returned: 0 in 0.293s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-quobyte-d77212ff-0343-4c79-add2-739c67fed0cd" released by "_delete_snapshot" :: held 1.734s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" released by "delete_snapshot" :: held 1.767s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:19 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Created reservations ['b6f52306-1bfe-4b8e-83cf-ef666eb79e49', '0a98b5c9-48af-4367-966b-20ed44bdf0db', 'd8572b31-465f-4bee-a701-9743cbf19144', '209279c1-4975-4452-9b48-c7fc865c4526'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:20 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Delete snapshot completed successfully. Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f463bf71-f6fc-40a4-a5a2-1c5bbd39cf02 tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-d77212ff-0343-4c79-add2-739c67fed0cd-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Creating offline snapshot 209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 of volume a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08da9d-9908-438a-8330-c801ed6c026d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:20 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 Sep 01 11:26:20 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "cinder-ecb5233f-6540-45d6-9264-ea9f7ba57ed9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-ecb5233f-6540-45d6-9264-ea9f7ba57ed9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d18fd20-cc59-4adb-ba6d-b5b909a44c1c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:20 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9" returned: 0 in 0.481s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:20 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 Sep 01 11:26:20 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:20 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 1G Sep 01 11:26:20 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:21 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" returned: 0 in 0.538s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:21 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9 Sep 01 11:26:21 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:21 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 1G" returned: 0 in 0.537s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:21 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 Sep 01 11:26:21 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:21 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" returned: 0 in 0.313s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-quobyte-ecb5233f-6540-45d6-9264-ea9f7ba57ed9" released by "delete_volume" :: held 0.925s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Created reservations ['c89ef884-865f-489f-953d-63bb674ce725', '5c507690-9a6c-4dcd-9f0d-e9b37d449842', '9c4a8628-1fe1-46fe-bd6e-ff06b91c4261', 'a9d01c4f-d2e9-4155-a57d-6b0f5eec2c6a'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:21 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" returned: 0 in 0.394s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:21 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 is being set with open permissions: ugo+rw Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:21 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:21 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:21 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 Sep 01 11:26:21 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:21 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" returned: 0 in 0.321s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:21 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.401s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Deleted volume successfully. Sep 01 11:26:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:22 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info Sep 01 11:26:22 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bb724298-bf54-42e3-80f1-6daa285bc03a tempest-SnapshotsActionsTest-1579292491 None] Lock "cinder-ecb5233f-6540-45d6-9264-ea9f7ba57ed9-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:22 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:22 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info is being set with open permissions: ugo+rw Sep 01 11:26:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:22 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info Sep 01 11:26:22 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:22 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.info" returned: 0 in 0.309s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-56f4e70b-553c-48f7-b5a1-c7c7168fab6b tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Create snapshot completed successfully Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "cinder-209bbce0-1cf2-48f2-a1f2-1ca36f0521e1-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-209bbce0-1cf2-48f2-a1f2-1ca36f0521e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "cinder-quobyte-a242f5ec-4c78-45d9-80a5-48373fb59df9" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-quobyte-a242f5ec-4c78-45d9-80a5-48373fb59df9" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "cinder-quobyte-209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-quobyte-209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Deleting offline snapshot 209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 of volume a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] snapshot_file for this snap is: volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ce348-c1f2-4691-836c-f35cc4a7c3d1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:24 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 Sep 01 11:26:24 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:24 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" returned: 0 in 0.539s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a242f5ec-4c78-45d9-80a5-48373fb59df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5c9056-7990-4eba-8281-1c3f94d01850]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5408d5b-fcd4-4225-a1e1-864b5073d157]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:24 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 Sep 01 11:26:24 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:24 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:24 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:25 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Flow 'volume_create_manager' (ee3379f5-521e-49d9-a347-64d04f08ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3b5535-e0d0-45e0-b3a6-381bed4a2020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9" returned: 0 in 0.789s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:25 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 Sep 01 11:26:25 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:25 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3b5535-e0d0-45e0-b3a6-381bed4a2020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-590228435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66e5824-f873-4660-a9ae-b4da67cdcee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfed2c01cce543509d6887588870dc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:25Z,use_quota=True,user_id='e0e5699d809744be931c24c713ed5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a9de63-d0a3-46aa-84a0-01c6e9160312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a9de63-d0a3-46aa-84a0-01c6e9160312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896f727a-89c5-4ca7-bfa0-71ed86d5c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896f727a-89c5-4ca7-bfa0-71ed86d5c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66e5824-f873-4660-a9ae-b4da67cdcee6', 'volume_name': 'volume-e66e5824-f873-4660-a9ae-b4da67cdcee6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4780fce9-856d-4352-95d5-be9604e921af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4780fce9-856d-4352-95d5-be9604e921af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241c13f-725d-4d05-98f1-6c27681ad6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:25 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Volume e66e5824-f873-4660-a9ae-b4da67cdcee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66e5824-f873-4660-a9ae-b4da67cdcee6', 'volume_size': 1} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 0.724s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:25 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:25 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:25 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" returned: 0 in 0.473s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:25 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1 Sep 01 11:26:25 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:25 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 1 in 0.462s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.270s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-590228435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66e5824-f873-4660-a9ae-b4da67cdcee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfed2c01cce543509d6887588870dc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:25Z,use_quota=True,user_id='e0e5699d809744be931c24c713ed5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Creating volume e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:25 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:26 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 1073741824 Sep 01 11:26:26 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-6bacf325-0862-4876-a396-133854c29e10', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1eaf276e-2d10-4217-a523-567e15d18294', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:26:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-a5b85b92-3b12-49fe-b0b6-b5a558c5cf8d req-ad926e5a-3cd9-462f-91ec-72a647545c3d tempest-ServerActionsTestOtherA-233561984 None] attachment_update completed successfully. Sep 01 11:26:26 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9.209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" returned: 0 in 0.414s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-quobyte-209bbce0-1cf2-48f2-a1f2-1ca36f0521e1" released by "_delete_snapshot" :: held 2.403s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-quobyte-a242f5ec-4c78-45d9-80a5-48373fb59df9" released by "delete_snapshot" :: held 2.440s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Created reservations ['15b7762d-c4e4-4707-b11b-8315d17fa0cf', 'ab621a24-92ab-4b89-8f66-5dad13999b54', '0b5f940e-a52a-44a2-b210-f736ebde2ea2', 'f8147cbd-b878-44b4-af26-caaf26b8acce'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Delete snapshot completed successfully. Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9162dbbb-5aa1-46d4-bc51-97558cd6b32f tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-209bbce0-1cf2-48f2-a1f2-1ca36f0521e1-delete_snapshot" released by "delete_snapshot" :: held 2.671s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:26 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 1073741824" returned: 0 in 0.607s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:26 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 Sep 01 11:26:26 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:26 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6" returned: 0 in 0.334s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241c13f-725d-4d05-98f1-6c27681ad6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66e5824-f873-4660-a9ae-b4da67cdcee6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96df6a78-2149-4d51-82ab-cf1adeb3cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:27 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Volume volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 (e66e5824-f873-4660-a9ae-b4da67cdcee6): created successfully Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96df6a78-2149-4d51-82ab-cf1adeb3cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Flow 'volume_create_manager' (ee3379f5-521e-49d9-a347-64d04f08ff74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-188c3c0b-86cf-4591-b071-59acea1e648a req-b00611d4-5f77-473d-8d2c-3c2f12453efa tempest-VolumesSnapshotsTestJSON-1008572789 None] Created volume successfully. Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "cinder-a242f5ec-4c78-45d9-80a5-48373fb59df9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-a242f5ec-4c78-45d9-80a5-48373fb59df9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "cinder-quobyte-a242f5ec-4c78-45d9-80a5-48373fb59df9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-quobyte-a242f5ec-4c78-45d9-80a5-48373fb59df9" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da1b611-88eb-4749-9a25-2c53028a6767]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:27 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 Sep 01 11:26:27 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Creating offline snapshot eac12b90-094f-4ecf-9550-cc81da8bf6a5 of volume e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa3ba94-1476-4709-80a7-2aceafd289f2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:28 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9" returned: 0 in 0.626s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:28 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9 Sep 01 11:26:28 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:28 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 Sep 01 11:26:28 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:28 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a242f5ec-4c78-45d9-80a5-48373fb59df9" returned: 0 in 0.472s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-quobyte-a242f5ec-4c78-45d9-80a5-48373fb59df9" released by "delete_volume" :: held 1.178s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Created reservations ['2d079ed9-0d28-4675-a3fd-9f191639f44c', '17acb7a9-55de-4d07-878e-64be4012fd36', '98d988f2-0102-4bec-9f7c-5af7afd38335', '84d65e28-a671-41ab-94f3-274741c0a4d5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:28 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6" returned: 0 in 0.683s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:28 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 1G Sep 01 11:26:28 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:28 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:28 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:29 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.585s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:29 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Deleted volume successfully. Sep 01 11:26:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-32ac7caa-e619-4d15-b8f1-699e0b29fd52 tempest-VolumeSnapshotQuotasNegativeTestJSON-267213020 None] Lock "cinder-a242f5ec-4c78-45d9-80a5-48373fb59df9-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:29 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 1G" returned: 0 in 0.855s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:29 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 Sep 01 11:26:29 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:30 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5" returned: 0 in 0.667s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:30 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 is being set with open permissions: ugo+rw Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:30 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 Sep 01 11:26:30 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Flow 'volume_create_manager' (db88d8da-4f4d-42c1-83f3-ccbfe191974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a21b873-6fcd-4782-8fc9-0f3b14cddb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a21b873-6fcd-4782-8fc9-0f3b14cddb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-585887688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebf80bc-1420-4a21-b2c0-fc80cafe7de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8a74459bae4f90bfadfdf6f04d0948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:30Z,use_quota=True,user_id='326df52045d443a69c611fe6bf8030ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e45fe2d-b2bf-4dd8-b3ae-b09f5da35ae0),volume_type_id=9e45fe2d-b2bf-4dd8-b3ae-b09f5da35ae0)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aefe790-5cd6-4c84-9380-2288374cacf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aefe790-5cd6-4c84-9380-2288374cacf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464658a7-c46e-4d1a-9ee2-0c8c348e0334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464658a7-c46e-4d1a-9ee2-0c8c348e0334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebf80bc-1420-4a21-b2c0-fc80cafe7de0', 'volume_name': 'volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674c6aea-8775-4f45-82ec-4acda8ea8fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674c6aea-8775-4f45-82ec-4acda8ea8fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c663708a-8098-4d4c-9fbd-c048fdd5605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Volume 1ebf80bc-1420-4a21-b2c0-fc80cafe7de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0', 'volume_size': 1} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:30 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5" returned: 0 in 0.385s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:30 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info Sep 01 11:26:30 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:31 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info" returned: 0 in 0.391s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:31 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info is being set with open permissions: ugo+rw Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:31 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info Sep 01 11:26:31 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:31 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.info" returned: 0 in 0.429s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.558s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-585887688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebf80bc-1420-4a21-b2c0-fc80cafe7de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8a74459bae4f90bfadfdf6f04d0948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:30Z,use_quota=True,user_id='326df52045d443a69c611fe6bf8030ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e45fe2d-b2bf-4dd8-b3ae-b09f5da35ae0),volume_type_id=9e45fe2d-b2bf-4dd8-b3ae-b09f5da35ae0)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Creating volume 1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:31 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:31 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 1073741824 Sep 01 11:26:31 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-cbec9d9e-8ef5-4839-9245-e1c168ba18eb req-48f51955-1de7-47e0-bd1a-b7b70a8ae49d tempest-VolumesSnapshotsTestJSON-1008572789 None] Create snapshot completed successfully Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "cinder-eac12b90-094f-4ecf-9550-cc81da8bf6a5-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-eac12b90-094f-4ecf-9550-cc81da8bf6a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "cinder-quobyte-e66e5824-f873-4660-a9ae-b4da67cdcee6" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-quobyte-e66e5824-f873-4660-a9ae-b4da67cdcee6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "cinder-quobyte-eac12b90-094f-4ecf-9550-cc81da8bf6a5" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-quobyte-eac12b90-094f-4ecf-9550-cc81da8bf6a5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Deleting offline snapshot eac12b90-094f-4ecf-9550-cc81da8bf6a5 of volume e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:26:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] snapshot_file for this snap is: volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[249c3974-36d1-4bf7-92c2-da474398380f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:32 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 Sep 01 11:26:32 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:32 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 1073741824" returned: 0 in 1.000s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:32 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 Sep 01 11:26:32 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:32 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5" returned: 0 in 0.743s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e66e5824-f873-4660-a9ae-b4da67cdcee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c4030-cc6f-466d-9866-b9ede25ba91b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:33 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 Sep 01 11:26:33 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:33 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0" returned: 0 in 0.704s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c663708a-8098-4d4c-9fbd-c048fdd5605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca9bf56-3f66-4e34-b9ca-4696be55c0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Volume volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 (1ebf80bc-1420-4a21-b2c0-fc80cafe7de0): created successfully Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca9bf56-3f66-4e34-b9ca-4696be55c0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Flow 'volume_create_manager' (db88d8da-4f4d-42c1-83f3-ccbfe191974e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7634a92a-f60b-4f1b-ad36-9bb62675af1c tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Created volume successfully. Sep 01 11:26:33 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6" returned: 0 in 0.741s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:33 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 Sep 01 11:26:33 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:34 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5" returned: 0 in 0.855s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:34 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5 Sep 01 11:26:34 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:34 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:34 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:35 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6.eac12b90-094f-4ecf-9550-cc81da8bf6a5" returned: 0 in 0.650s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-quobyte-eac12b90-094f-4ecf-9550-cc81da8bf6a5" released by "_delete_snapshot" :: held 3.265s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-quobyte-e66e5824-f873-4660-a9ae-b4da67cdcee6" released by "delete_snapshot" :: held 3.298s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG cinder.quota [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Created reservations ['950d0a4f-52e8-405b-8d7d-5f2dc75d12db', '0d828484-53fd-4cd8-8b2d-eb51cb1853dd', 'b771791c-a749-4b12-9e5b-b2c1568e9360', 'a3fc4db0-dc68-4101-8339-9ad87085faed'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:35 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.590s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6d63cccc-253b-41db-be8a-19b79a9466c1 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Retype volume completed successfully. Sep 01 11:26:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Delete snapshot completed successfully. Sep 01 11:26:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-a36a7ed3-537e-4d95-ba0b-61d8fe1daf17 req-08860478-1044-41cf-a56b-e40900f8d0c9 tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-eac12b90-094f-4ecf-9550-cc81da8bf6a5-delete_snapshot" released by "delete_snapshot" :: held 3.552s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Acquiring lock "cinder-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "cinder-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Acquiring lock "cinder-quobyte-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "cinder-quobyte-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0" acquired by "delete_volume" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8dc1e-0dbd-4a9f-b161-d329ac46c4b7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "cinder-e66e5824-f873-4660-a9ae-b4da67cdcee6-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-e66e5824-f873-4660-a9ae-b4da67cdcee6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "cinder-quobyte-e66e5824-f873-4660-a9ae-b4da67cdcee6" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-quobyte-e66e5824-f873-4660-a9ae-b4da67cdcee6" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:36 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 Sep 01 11:26:36 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:37 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e517f92c-75b0-4d27-85aa-a2e32ab773f3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:37 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 Sep 01 11:26:37 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:37 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0" returned: 0 in 0.883s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:37 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0 Sep 01 11:26:37 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:37 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6" returned: 0 in 0.752s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:37 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6 Sep 01 11:26:37 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:38 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0" returned: 0 in 0.493s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "cinder-quobyte-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0" released by "delete_volume" :: held 1.459s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:38 devstack cinder-volume[87144]: WARNING cinder.quota [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:26:38 devstack cinder-volume[87144]: WARNING cinder.quota [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Created reservations ['37c12dcb-ff9b-4c6a-815c-44f506ee332e', 'f2af1568-6c72-4d32-90ce-3d9ef5bc54e3', 'fd1142e0-626a-4daa-a902-e26ec29c2ace', 'd40050be-25bd-4c09-bce9-590ef97f015d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:38 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e66e5824-f873-4660-a9ae-b4da67cdcee6" returned: 0 in 0.508s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:38 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-quobyte-e66e5824-f873-4660-a9ae-b4da67cdcee6" released by "delete_volume" :: held 1.390s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:38 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.quota [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Created reservations ['2dfd81ea-7ffb-4609-9e1f-49aeaed8a05b', 'c39f9428-2986-4b5b-b7bd-42071436d26b', 'b0e043e9-fcf9-495f-869c-0ffd0059f9b0', '0054050a-201f-4e00-9283-59c36e047726'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:38 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:38 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:38 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.409s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Deleted volume successfully. Sep 01 11:26:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d13a51f-ce88-4dfe-8448-7a92d2a5d203 tempest-VolumeRetypeWithoutMigrationTest-679777936 None] Lock "cinder-1ebf80bc-1420-4a21-b2c0-fc80cafe7de0-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:39 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.621s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:39 devstack cinder-volume[87144]: DEBUG cinder.manager [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Deleted volume successfully. Sep 01 11:26:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-8f1a5ac8-d03d-465f-8584-97d68f382a10 req-daa6f79b-5a69-4f8c-8ebf-2eb66473a42f tempest-VolumesSnapshotsTestJSON-1008572789 None] Lock "cinder-e66e5824-f873-4660-a9ae-b4da67cdcee6-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-2f4bb3c4-6d86-4db8-a51d-aa2e7947e198 tempest-ServerActionsTestOtherA-233561984 None] Terminate volume connection completed successfully. Sep 01 11:26:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-2f4bb3c4-6d86-4db8-a51d-aa2e7947e198 tempest-ServerActionsTestOtherA-233561984 None] Deleting attachment 1eaf276e-2d10-4217-a523-567e15d18294. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Flow 'volume_create_manager' (ecd59ddc-3355-4b8e-9c08-a39c9b08b5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5876aa34-f5ea-4bf9-8c60-97fa9d54ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5876aa34-f5ea-4bf9-8c60-97fa9d54ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1342641954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c1ac00-fa14-4722-89f8-f1ef76d39a8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c4ff5b235b44d4b3894bf889c46def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:47Z,use_quota=True,user_id='80cb2d3abc734d28a270d3afd5e2444f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f790cfa-55f3-4b17-886f-493ebc540d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f790cfa-55f3-4b17-886f-493ebc540d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea4c217-50e3-4a01-911a-0a4b35146a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea4c217-50e3-4a01-911a-0a4b35146a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c1ac00-fa14-4722-89f8-f1ef76d39a8d', 'volume_name': 'volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827954eb-13c7-499c-b334-d7000e5468fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827954eb-13c7-499c-b334-d7000e5468fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c5cf55-2180-48c5-83d0-2a1b960b0300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:46 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Volume 07c1ac00-fa14-4722-89f8-f1ef76d39a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d', 'volume_size': 1} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea76b4e1-caf8-467f-a4d6-cbeaba206119]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:46 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:46 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:47 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 0.413s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:47 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:47 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:47 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 1 in 0.380s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.854s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1342641954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c1ac00-fa14-4722-89f8-f1ef76d39a8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c4ff5b235b44d4b3894bf889c46def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:47Z,use_quota=True,user_id='80cb2d3abc734d28a270d3afd5e2444f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Creating volume 07c1ac00-fa14-4722-89f8-f1ef76d39a8d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:47 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:47 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d 1073741824 Sep 01 11:26:47 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-6bacf325-0862-4876-a396-133854c29e10', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08f9fa3d-2a8e-4940-a7b3-d9ca26b64a3e', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:26:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-3715bd44-3606-4fda-93eb-2cf4e1310444 req-ad74f2e0-194b-4b50-9a59-8c9c3ef7b51a tempest-ServerActionsTestOtherA-233561984 None] attachment_update completed successfully. Sep 01 11:26:48 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d 1073741824" returned: 0 in 0.649s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=149,cinder:DELETE=5,cinder:INSERT=35,cinder:UPDATE=137 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=131,cinder:UPDATE=136,cinder:INSERT=45,cinder:DELETE=11 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:48 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d Sep 01 11:26:48 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Flow 'volume_create_manager' (bf172d61-a711-4b8a-9d18-f8e4e2e1ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d79b1c7-17dc-4419-9639-7f19303ad3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d79b1c7-17dc-4419-9639-7f19303ad3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1796920346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6184a75-feee-4ed4-a210-79525a491201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dbc1830d1540a3af5983ee64372daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:48Z,use_quota=True,user_id='8be2ed759b114c959a2c7f1bd1f76069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca52f5a3-8801-4a13-87ba-bfa27ab835a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca52f5a3-8801-4a13-87ba-bfa27ab835a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dba47fa-af5b-486b-8201-4c26e8201a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dba47fa-af5b-486b-8201-4c26e8201a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6184a75-feee-4ed4-a210-79525a491201', 'volume_name': 'volume-f6184a75-feee-4ed4-a210-79525a491201', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f1aa3a-9dc9-474a-9c15-50a7b5511835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f1aa3a-9dc9-474a-9c15-50a7b5511835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015d741a-b777-4abd-a1a5-0b6d3df673b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Volume f6184a75-feee-4ed4-a210-79525a491201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6184a75-feee-4ed4-a210-79525a491201', 'volume_size': 1} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:48 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d" returned: 0 in 0.449s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1796920346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6184a75-feee-4ed4-a210-79525a491201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dbc1830d1540a3af5983ee64372daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:48Z,use_quota=True,user_id='8be2ed759b114c959a2c7f1bd1f76069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Creating volume f6184a75-feee-4ed4-a210-79525a491201 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:48 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c5cf55-2180-48c5-83d0-2a1b960b0300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817d44fe-b661-4b8b-83e9-58ce039262fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:48 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 1073741824 Sep 01 11:26:48 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Volume volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d (07c1ac00-fa14-4722-89f8-f1ef76d39a8d): created successfully Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817d44fe-b661-4b8b-83e9-58ce039262fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Flow 'volume_create_manager' (ecd59ddc-3355-4b8e-9c08-a39c9b08b5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-3569fc66-5cf0-4c60-8193-fb2518d32ed7 req-4b65d14c-562a-493b-8bb6-3f3ec1a0c137 tempest-VolumesGetTestJSON-1310065697 None] Created volume successfully. Sep 01 11:26:49 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 1073741824" returned: 0 in 0.995s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Acquiring lock "cinder-07c1ac00-fa14-4722-89f8-f1ef76d39a8d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:49 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 Sep 01 11:26:49 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Lock "cinder-07c1ac00-fa14-4722-89f8-f1ef76d39a8d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Acquiring lock "cinder-quobyte-07c1ac00-fa14-4722-89f8-f1ef76d39a8d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Lock "cinder-quobyte-07c1ac00-fa14-4722-89f8-f1ef76d39a8d" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37edde5b-f754-4c80-919d-0503b4f99e42]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:50 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201" returned: 0 in 0.420s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015d741a-b777-4abd-a1a5-0b6d3df673b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6184a75-feee-4ed4-a210-79525a491201', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fa4cf-91d6-40d1-82e8-d5ad41e80d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:50 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d Sep 01 11:26:50 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:50 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Volume volume-f6184a75-feee-4ed4-a210-79525a491201 (f6184a75-feee-4ed4-a210-79525a491201): created successfully Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fa4cf-91d6-40d1-82e8-d5ad41e80d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Flow 'volume_create_manager' (bf172d61-a711-4b8a-9d18-f8e4e2e1ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:50 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d744fcc4-fa15-45a2-9796-9af729c63c94 tempest-VolumesServicesTestJSON-1143361371 None] Created volume successfully. Sep 01 11:26:50 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d" returned: 0 in 0.600s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:50 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d Sep 01 11:26:50 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Acquiring lock "cinder-f6184a75-feee-4ed4-a210-79525a491201-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Lock "cinder-f6184a75-feee-4ed4-a210-79525a491201-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Acquiring lock "cinder-quobyte-f6184a75-feee-4ed4-a210-79525a491201" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Lock "cinder-quobyte-f6184a75-feee-4ed4-a210-79525a491201" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[892dc6d5-ca5f-4786-8437-b1a1fd7f7e9d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:50 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-07c1ac00-fa14-4722-89f8-f1ef76d39a8d" returned: 0 in 0.347s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Lock "cinder-quobyte-07c1ac00-fa14-4722-89f8-f1ef76d39a8d" released by "delete_volume" :: held 1.020s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:50 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 Sep 01 11:26:50 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.quota [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Created reservations ['8a062a88-c7d8-40bc-8e4e-280f857c7edd', '9b061e54-5399-45e1-a7fb-cdeb16c29274', '339373a3-02db-46aa-8692-09b2d4c3053c', 'b164ec08-6454-46d4-b6b1-d4055dd90c18'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:51 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:51 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:51 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201" returned: 0 in 0.498s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:51 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201 Sep 01 11:26:51 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:51 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.269s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.manager [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Deleted volume successfully. Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-ec19a2ce-3cc9-465e-b35d-2093155be361 req-855cd9af-c027-4cc1-b52a-77d0359be1b0 tempest-VolumesGetTestJSON-1310065697 None] Lock "cinder-07c1ac00-fa14-4722-89f8-f1ef76d39a8d-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:51 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6184a75-feee-4ed4-a210-79525a491201" returned: 0 in 0.330s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Lock "cinder-quobyte-f6184a75-feee-4ed4-a210-79525a491201" released by "delete_volume" :: held 0.907s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Created reservations ['9310608e-1a8b-4e86-9db9-50a87a386452', '3f1730e6-25d8-4ea9-8feb-72a8ac8b99c1', 'ab2cedf4-9c0c-4744-bdd2-ecb058e6ab7c', '4a2616a6-8781-48f5-b002-d7820f5fcf6e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:51 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:51 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:52 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.285s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:52 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:52 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Deleted volume successfully. Sep 01 11:26:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa62239f-66ed-408d-a139-6b8fe4c71962 tempest-VolumesServicesTestJSON-1143361371 None] Lock "cinder-f6184a75-feee-4ed4-a210-79525a491201-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-e364b8e6-8ed6-4ae2-9e7b-bfd91cb5f55f tempest-ServerActionsTestOtherA-233561984 None] Terminate volume connection completed successfully. Sep 01 11:26:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-e364b8e6-8ed6-4ae2-9e7b-bfd91cb5f55f tempest-ServerActionsTestOtherA-233561984 None] Deleting attachment 08f9fa3d-2a8e-4940-a7b3-d9ca26b64a3e. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:26:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "cinder-6bacf325-0862-4876-a396-133854c29e10-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-6bacf325-0862-4876-a396-133854c29e10-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "cinder-quobyte-6bacf325-0862-4876-a396-133854c29e10" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-quobyte-6bacf325-0862-4876-a396-133854c29e10" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6732f3c8-dc3c-47e6-b671-99f668425580]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:54 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:54 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:54 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 0.495s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:54 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:54 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:55 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 1 in 0.592s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:55 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10 Sep 01 11:26:55 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:55 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6bacf325-0862-4876-a396-133854c29e10" returned: 0 in 0.331s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-quobyte-6bacf325-0862-4876-a396-133854c29e10" released by "delete_volume" :: held 1.536s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG cinder.quota [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Created reservations ['fd6790c4-293d-4b4b-9a78-b35d2f7a6ab4', '4318e78f-d1ad-443c-aed9-8bc89f76d3c3', '91c66dd5-5946-4e6f-ad89-05910bfbef12', 'fcb440dd-937a-4ef4-a2d5-9096f34ea6df'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:55 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:55 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "cinder-b2f386ed-de92-4d46-bfd6-b28f3853a936-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-b2f386ed-de92-4d46-bfd6-b28f3853a936-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "cinder-quobyte-b2f386ed-de92-4d46-bfd6-b28f3853a936" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-quobyte-b2f386ed-de92-4d46-bfd6-b28f3853a936" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb88b481-7f41-4d6b-9767-6ddd2af3a041]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:56 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.504s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.manager [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Deleted volume successfully. Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-0a2afa5f-935f-4900-a189-3b4edd71bceb req-f9fa892d-4b84-4ec5-a069-7e251b2e3013 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-6bacf325-0862-4876-a396-133854c29e10-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:56 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 Sep 01 11:26:56 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:56 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936" returned: 0 in 0.421s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:56 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936 Sep 01 11:26:56 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:56 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2f386ed-de92-4d46-bfd6-b28f3853a936" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-quobyte-b2f386ed-de92-4d46-bfd6-b28f3853a936" released by "delete_volume" :: held 0.751s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Created reservations ['6bba2948-d29f-4a4f-ab2e-5b5a24f43fc7', 'd2dd8df6-8674-454b-aed6-39d307c62ac1', '078fd0b2-cc9f-49f5-9b76-9c82ffce8cba', '498755f3-8fbe-41a5-a432-e53ac5eb2070'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:57 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:26:57 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:57 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.450s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:57 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:26:57 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Deleted volume successfully. Sep 01 11:26:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8220a07-e110-4b9a-bb07-cb3e89091a48 tempest-ServerActionsTestOtherA-233561984 None] Lock "cinder-b2f386ed-de92-4d46-bfd6-b28f3853a936-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Flow 'volume_create_manager' (c45b48bb-c888-4b0a-873c-b00a064a1260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22732d2e-2885-41e8-bf9b-42d7158020a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22732d2e-2885-41e8-bf9b-42d7158020a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1613382889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd14a62938054b1ea6f1df0ab5a739f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:58Z,use_quota=True,user_id='e6034f16eb1a4ff49fbe72dd6a7e4572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20593bb4-06ec-4be6-ae3b-a3adae108a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20593bb4-06ec-4be6-ae3b-a3adae108a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258cf58e-644c-471d-ba0e-5ec70ddf998e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258cf58e-644c-471d-ba0e-5ec70ddf998e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3', 'volume_name': 'volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3334698-b7fa-47c2-a2eb-af8811241083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3334698-b7fa-47c2-a2eb-af8811241083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034b9039-db2a-444e-bd68-07b15f395d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:58 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Volume 62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3', 'volume_size': 1} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1613382889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd14a62938054b1ea6f1df0ab5a739f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:26:58Z,use_quota=True,user_id='e6034f16eb1a4ff49fbe72dd6a7e4572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Creating volume 62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:26:58 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:26:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:58 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 1073741824 Sep 01 11:26:58 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:59 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 1073741824" returned: 0 in 0.632s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:26:59 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 Sep 01 11:26:59 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:26:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c68b0241-ea4e-4678-8e9e-c0a3703ce3a8 tempest-GroupSnapshotsV319Test-997025105 None] Group tempest-GroupSnapshotsV319Test-Group-1508133266: creating Sep 01 11:26:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c68b0241-ea4e-4678-8e9e-c0a3703ce3a8 tempest-GroupSnapshotsV319Test-997025105 None] Group tempest-GroupSnapshotsV319Test-Group-1508133266: created successfully Sep 01 11:26:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c68b0241-ea4e-4678-8e9e-c0a3703ce3a8 tempest-GroupSnapshotsV319Test-997025105 None] Create group completed successfully. Sep 01 11:26:59 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" returned: 0 in 0.456s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034b9039-db2a-444e-bd68-07b15f395d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e80ac4-ca5f-4d4d-a7f4-4ea487635372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:26:59 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Volume volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 (62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3): created successfully Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e80ac4-ca5f-4d4d-a7f4-4ea487635372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:26:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Flow 'volume_create_manager' (c45b48bb-c888-4b0a-873c-b00a064a1260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:26:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f2ad2d8c-2f8b-475a-a2f7-1feafa8be494 tempest-SnapshotMetadataTestJSON-1899267404 None] Created volume successfully. Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Creating offline snapshot ddd4a1db-656f-423a-b04c-e4de44281305 of volume 62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c67029-fcb0-4eae-9ae4-bf2a95689b8b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:00 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 Sep 01 11:27:00 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Flow 'volume_create_manager' (831e0bd9-1318-473a-80e1-4f0f9af3fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410b1cb9-9338-474b-9737-7995a65860fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410b1cb9-9338-474b-9737-7995a65860fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-365921953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cba9168-981c-4d80-b80b-27d3e4a1a3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='714d8768b6454929a05dc7d3d0836861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:01Z,use_quota=True,user_id='b3c9852049d24247afdcf72455304c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aeec0282-9c7b-4e01-94ba-e75dd31b4e7e),volume_type_id=aeec0282-9c7b-4e01-94ba-e75dd31b4e7e)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b0123e-156e-437f-a1f3-5bd7275f4aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b0123e-156e-437f-a1f3-5bd7275f4aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbda84b-94f0-49da-b405-850022eb05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbda84b-94f0-49da-b405-850022eb05cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cba9168-981c-4d80-b80b-27d3e4a1a3bb', 'volume_name': 'volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6be393-27d4-43dd-9c6a-1e6de1b1bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6be393-27d4-43dd-9c6a-1e6de1b1bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca1b658-b28f-405e-a4de-9285d3d7965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Volume 0cba9168-981c-4d80-b80b-27d3e4a1a3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb', 'volume_size': 1} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" returned: 0 in 0.456s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:01 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 1G Sep 01 11:27:01 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Flow 'volume_create_manager' (f7d65693-2481-4df0-a427-d4d142be67e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b041d581-3209-46a1-a624-8f9529a8fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b041d581-3209-46a1-a624-8f9529a8fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-588102940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e5f51d8-12aa-456b-8fc3-4d4546397b61,host='devstack@QuobyteHD#QuobyteHD',id=dacc4d12-d6e4-48a0-8db8-c368bf48a8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21c7f0656842d69419d378930529c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:01Z,use_quota=True,user_id='d3300d61912b4e8992435d6e3bcfa59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac656c37-182a-4451-9f8c-6c70393344e0),volume_type_id=ac656c37-182a-4451-9f8c-6c70393344e0)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd77280-545d-45b9-a43b-1b942d2e8022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd77280-545d-45b9-a43b-1b942d2e8022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdd2f1b-fab5-40cd-8e4a-a020c895df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdd2f1b-fab5-40cd-8e4a-a020c895df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dacc4d12-d6e4-48a0-8db8-c368bf48a8b8', 'volume_name': 'volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811fd7f-2f0f-4ac0-bf94-8e52da3bc5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811fd7f-2f0f-4ac0-bf94-8e52da3bc5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f6583a-54c2-4228-a103-11b9d1171b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Volume dacc4d12-d6e4-48a0-8db8-c368bf48a8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8', 'volume_size': 1} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:01 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 1G" returned: 0 in 0.468s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:01 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 Sep 01 11:27:01 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:01 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:01 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 is being set with open permissions: ugo+rw Sep 01 11:27:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:01 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 Sep 01 11:27:01 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:02 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305" returned: 0 in 0.262s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:02 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info Sep 01 11:27:02 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:02 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:02 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info is being set with open permissions: ugo+rw Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:02 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info Sep 01 11:27:02 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:02 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.info" returned: 0 in 0.296s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-365921953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cba9168-981c-4d80-b80b-27d3e4a1a3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='714d8768b6454929a05dc7d3d0836861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:01Z,use_quota=True,user_id='b3c9852049d24247afdcf72455304c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aeec0282-9c7b-4e01-94ba-e75dd31b4e7e),volume_type_id=aeec0282-9c7b-4e01-94ba-e75dd31b4e7e)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Creating volume 0cba9168-981c-4d80-b80b-27d3e4a1a3bb {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:27:02 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:27:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:02 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb 1073741824 Sep 01 11:27:02 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e650339a-228e-4063-a364-e161d5dd7e2d tempest-SnapshotMetadataTestJSON-1899267404 None] Create snapshot completed successfully Sep 01 11:27:03 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb 1073741824" returned: 0 in 0.436s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:03 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb Sep 01 11:27:03 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:03 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e5f51d8-12aa-456b-8fc3-4d4546397b61,created_at=2026-09-01T09:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-588102940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e5f51d8-12aa-456b-8fc3-4d4546397b61,host='devstack@QuobyteHD#QuobyteHD',id=dacc4d12-d6e4-48a0-8db8-c368bf48a8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21c7f0656842d69419d378930529c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:01Z,use_quota=True,user_id='d3300d61912b4e8992435d6e3bcfa59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac656c37-182a-4451-9f8c-6c70393344e0),volume_type_id=ac656c37-182a-4451-9f8c-6c70393344e0)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Creating volume dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:27:03 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca1b658-b28f-405e-a4de-9285d3d7965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f93fd9-9210-4817-aa08-be988b7bd409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:03 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 1073741824 Sep 01 11:27:03 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:03 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Volume volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb (0cba9168-981c-4d80-b80b-27d3e4a1a3bb): created successfully Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f93fd9-9210-4817-aa08-be988b7bd409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Flow 'volume_create_manager' (831e0bd9-1318-473a-80e1-4f0f9af3fc03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:03 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f32a1b6f-fa58-4a9f-a5d7-73d5021c05c1 tempest-VolumeTypesAccessTest-513104619 None] Created volume successfully. Sep 01 11:27:04 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 1073741824" returned: 0 in 0.565s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:04 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 Sep 01 11:27:04 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Acquiring lock "cinder-0cba9168-981c-4d80-b80b-27d3e4a1a3bb-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Lock "cinder-0cba9168-981c-4d80-b80b-27d3e4a1a3bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Acquiring lock "cinder-quobyte-0cba9168-981c-4d80-b80b-27d3e4a1a3bb" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Lock "cinder-quobyte-0cba9168-981c-4d80-b80b-27d3e4a1a3bb" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d783b-52df-4c1b-91b1-07495dc112a4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:04 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb Sep 01 11:27:04 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:04 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" returned: 0 in 0.400s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f6583a-54c2-4228-a103-11b9d1171b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d05536-9a62-4982-ae3c-cd13be00e571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:04 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:27:04 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:04 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Volume volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 (dacc4d12-d6e4-48a0-8db8-c368bf48a8b8): created successfully Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d05536-9a62-4982-ae3c-cd13be00e571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Flow 'volume_create_manager' (f7d65693-2481-4df0-a427-d4d142be67e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d4b66d8f-c159-4734-8dd7-3c1c005b662c tempest-GroupSnapshotsV319Test-997025105 None] Created volume successfully. Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "cinder-ddd4a1db-656f-423a-b04c-e4de44281305-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-ddd4a1db-656f-423a-b04c-e4de44281305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "cinder-quobyte-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-quobyte-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "cinder-quobyte-ddd4a1db-656f-423a-b04c-e4de44281305" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-quobyte-ddd4a1db-656f-423a-b04c-e4de44281305" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Deleting offline snapshot ddd4a1db-656f-423a-b04c-e4de44281305 of volume 62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:27:04 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] snapshot_file for this snap is: volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb" returned: 0 in 0.447s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fd9aed-e761-4250-8819-fae3a7dabc23]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:04 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb Sep 01 11:27:04 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:04 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.306s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:27:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:27:04 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 Sep 01 11:27:04 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:05 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0cba9168-981c-4d80-b80b-27d3e4a1a3bb" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Lock "cinder-quobyte-0cba9168-981c-4d80-b80b-27d3e4a1a3bb" released by "delete_volume" :: held 0.775s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:05 devstack cinder-volume[87144]: WARNING cinder.quota [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-592057907 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-592057907, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:27:05 devstack cinder-volume[87144]: WARNING cinder.quota [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-592057907 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-592057907, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Created reservations ['20f6711c-23f0-4374-93b3-992d9f7f1859', '939c4a51-b4e1-4165-9c42-fb42082f6433', '4933997a-7041-495b-9ea5-1b1da973298b', '558e2a9b-e569-4c66-be6a-2cb0b862dadc'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:05 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:05 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:27:05 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305" returned: 0 in 0.467s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbba233-7804-43fc-8635-8f30f22a7bfd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] GroupSnapshot b4f37744-3ae4-4b02-9fa0-0f67de4a0154: creating. Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Group snapshot b4f37744-3ae4-4b02-9fa0-0f67de4a0154: creating. {{(pid=87144) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Creating offline snapshot fa7de305-3680-4ab2-879e-d878ea88a412 of volume dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:27:05 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 Sep 01 11:27:05 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d14ce7-b579-4400-b6e4-523c774045ba]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:05 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.416s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:27:05 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 Sep 01 11:27:05 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Deleted volume successfully. Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08b91844-4603-4016-b3ac-cacff523690b tempest-VolumeTypesAccessTest-513104619 None] Lock "cinder-0cba9168-981c-4d80-b80b-27d3e4a1a3bb-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:05 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" returned: 0 in 0.626s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:05 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 Sep 01 11:27:05 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:06 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" returned: 0 in 0.543s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:06 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 1G Sep 01 11:27:06 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:06 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305" returned: 0 in 0.496s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:06 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305 Sep 01 11:27:06 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:06 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 1G" returned: 0 in 0.537s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:06 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 Sep 01 11:27:06 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:06 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3.ddd4a1db-656f-423a-b04c-e4de44281305" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-quobyte-ddd4a1db-656f-423a-b04c-e4de44281305" released by "_delete_snapshot" :: held 2.132s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-quobyte-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" released by "delete_snapshot" :: held 2.162s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Created reservations ['c2343578-d2bc-4750-ba38-2e62ff46308c', '5aba1ebf-64eb-4ce2-848b-47c5db6d765f', '264a64c0-8bfe-4710-aeb0-7c17468606ea', 'b12963ac-83e4-48a5-9f5f-a29243c97631'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Delete snapshot completed successfully. Sep 01 11:27:07 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412" returned: 0 in 0.502s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:07 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fd1698f7-3da1-4b37-b3e5-9f736daf4ce5 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-ddd4a1db-656f-423a-b04c-e4de44281305-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:07 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 Sep 01 11:27:07 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:07 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412" returned: 0 in 0.248s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:07 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info Sep 01 11:27:07 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:07 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:07 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:07 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info Sep 01 11:27:07 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:07 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.info" returned: 0 in 0.301s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "cinder-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5780bef5-f790-455b-9b2e-7d963c5464bf tempest-GroupSnapshotsV319Test-997025105 None] group_snapshot b4f37744-3ae4-4b02-9fa0-0f67de4a0154: created successfully Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "cinder-quobyte-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-quobyte-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c477317-7f22-473e-9c8e-a7a70b3f20bf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:08 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 Sep 01 11:27:08 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:08 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:08 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3 Sep 01 11:27:08 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:08 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-quobyte-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3" released by "delete_volume" :: held 0.811s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Created reservations ['3352489a-463d-4774-91c6-39dc77b2e794', 'a173d2fb-c593-431f-9e7f-41435e01264e', '1095c8c1-8328-4a9a-bc64-18e0500c6176', 'db9d8296-0ff9-4554-881b-b48e995190b3'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] group_snapshot b4f37744-3ae4-4b02-9fa0-0f67de4a0154: deleting Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] group_snapshot b4f37744-3ae4-4b02-9fa0-0f67de4a0154: deleting {{(pid=87144) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:09 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "cinder-quobyte-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:09 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Lock "cinder-quobyte-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "cinder-quobyte-fa7de305-3680-4ab2-879e-d878ea88a412" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Lock "cinder-quobyte-fa7de305-3680-4ab2-879e-d878ea88a412" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Deleting offline snapshot fa7de305-3680-4ab2-879e-d878ea88a412 of volume dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] snapshot_file for this snap is: volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a361db-92df-46c4-9dd7-cafd078223c9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:09 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 Sep 01 11:27:09 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:09 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.396s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:27:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Deleted volume successfully. Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e83c8ef-1cb7-4e3b-aa37-c474ddb64f40 tempest-SnapshotMetadataTestJSON-1899267404 None] Lock "cinder-62cc300b-3b4d-4a8c-95f1-8ccf5cbe00f3-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:09 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412" returned: 0 in 0.481s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff5a484-f542-4a66-81eb-d46c10f797fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:10 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 Sep 01 11:27:10 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:10 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" returned: 0 in 0.500s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:10 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 Sep 01 11:27:10 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:10 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:10 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412 Sep 01 11:27:10 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:11 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8.fa7de305-3680-4ab2-879e-d878ea88a412" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Lock "cinder-quobyte-fa7de305-3680-4ab2-879e-d878ea88a412" released by "_delete_snapshot" :: held 1.859s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Lock "cinder-quobyte-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" released by "delete_snapshot" :: held 1.917s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:11 devstack cinder-volume[87144]: WARNING cinder.quota [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1964781968 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1964781968, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:27:11 devstack cinder-volume[87144]: WARNING cinder.quota [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1964781968 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1964781968, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:27:11 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] Created reservations ['7de92e70-b42e-473f-a188-cd1e172ec99b', '47aed9d1-4cde-45cf-b6bb-83f12d72c6fa', '6736328d-c6c2-4899-b378-41ff0a50a30f', 'cb60fba4-f463-444a-b9c3-6148e8612177'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-aa9b73ee-7101-4e77-af90-72e83d7d8f8e tempest-GroupSnapshotsV319Test-997025105 None] group_snapshot b4f37744-3ae4-4b02-9fa0-0f67de4a0154: deleted successfully Sep 01 11:27:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "cinder-quobyte-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Lock "cinder-quobyte-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6efdd28-85cc-4001-8838-7780530df94b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:12 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 Sep 01 11:27:12 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:12 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" returned: 0 in 0.441s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:12 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8 Sep 01 11:27:12 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:12 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Lock "cinder-quobyte-dacc4d12-d6e4-48a0-8db8-c368bf48a8b8" released by "delete_volume" :: held 0.942s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Created reservations ['b3e5b927-4e96-422a-a1cd-636cd132646f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:13 devstack cinder-volume[87144]: WARNING cinder.quota [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1964781968 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1964781968, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Created reservations ['c141bd68-b1df-43dc-b188-e1857ad1a50c', '64f258db-da87-4135-9f03-a5327f44f6a9', '28d068d4-2b8e-47b3-a5ba-e516d6c0d850', '334c6325-f8a1-4bc7-95a4-9fa07f4ce1f9'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:13 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:27:13 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:13 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:13 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:27:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-64345df9-6933-4379-b776-9f95d21a2376 tempest-GroupSnapshotsV319Test-997025105 None] Delete group completed successfully. Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Flow 'volume_create_manager' (79be10d6-ce0f-4af3-ac4e-f50a073c0bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a5be9d-cc81-4a45-aeb7-33e089ee8475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a5be9d-cc81-4a45-aeb7-33e089ee8475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1695993018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cbc0d3e-2197-4875-ad83-7e1da6a77203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5079efe115f845339dbc0c4758a2ed91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:20Z,use_quota=True,user_id='85d2ee643102473fa1eb4076d23c9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d384924-43b4-40f5-acb2-d3609fffcd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d384924-43b4-40f5-acb2-d3609fffcd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef56b4e3-bbfa-4837-a28e-a5789910f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef56b4e3-bbfa-4837-a28e-a5789910f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cbc0d3e-2197-4875-ad83-7e1da6a77203', 'volume_name': 'volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe35444-a007-41cd-ac0c-502d070ef9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe35444-a007-41cd-ac0c-502d070ef9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc0c68d-3fa2-4ba9-bd7e-206ce1c03b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:20 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Volume 3cbc0d3e-2197-4875-ad83-7e1da6a77203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203', 'volume_size': 1} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1695993018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cbc0d3e-2197-4875-ad83-7e1da6a77203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5079efe115f845339dbc0c4758a2ed91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:20Z,use_quota=True,user_id='85d2ee643102473fa1eb4076d23c9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Creating volume 3cbc0d3e-2197-4875-ad83-7e1da6a77203 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:27:20 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:20 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 1073741824 Sep 01 11:27:20 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:20 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 1073741824" returned: 0 in 0.590s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:21 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 Sep 01 11:27:21 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:21 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203" returned: 0 in 0.345s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc0c68d-3fa2-4ba9-bd7e-206ce1c03b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1000344-90ea-4f68-b69a-082f344b619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Volume volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 (3cbc0d3e-2197-4875-ad83-7e1da6a77203): created successfully Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1000344-90ea-4f68-b69a-082f344b619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Flow 'volume_create_manager' (79be10d6-ce0f-4af3-ac4e-f50a073c0bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-20f6f672-7ed2-4854-aa8d-206dce61abbc tempest-VolumesTransfersV355Test-1100391609 None] Created volume successfully. Sep 01 11:27:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a36c21ec-4372-4b69-a90e-1abc22081d6d tempest-VolumesTransfersV355Test-1136720472 None] Transfer volume completed successfully. Sep 01 11:27:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Acquiring lock "cinder-3cbc0d3e-2197-4875-ad83-7e1da6a77203-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-3cbc0d3e-2197-4875-ad83-7e1da6a77203-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Acquiring lock "cinder-quobyte-3cbc0d3e-2197-4875-ad83-7e1da6a77203" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-quobyte-3cbc0d3e-2197-4875-ad83-7e1da6a77203" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d992da-8fa0-4a6c-a171-1b0a997d47dd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:24 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 Sep 01 11:27:24 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:25 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203" returned: 0 in 0.584s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:25 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203 Sep 01 11:27:25 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:25 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cbc0d3e-2197-4875-ad83-7e1da6a77203" returned: 0 in 0.477s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-quobyte-3cbc0d3e-2197-4875-ad83-7e1da6a77203" released by "delete_volume" :: held 1.142s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Created reservations ['1f61ed8f-1825-41cc-8e51-ad9a44da6d26', '4105902c-1285-4ebd-9802-566278dff3a3', 'b37eddf2-1b13-49d4-9219-df5181b6a6f8', '4c0ac452-455e-4cf7-ae5a-2295039a2080'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:25 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:27:25 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:26 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:26 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:27:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Deleted volume successfully. Sep 01 11:27:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5b03c8ac-b901-4eaf-870c-4c2d4db0d391 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-3cbc0d3e-2197-4875-ad83-7e1da6a77203-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Flow 'volume_create_manager' (f601cd72-cbae-4f4f-b2ce-c6cec853e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d816b23-3900-4505-942d-e7dd1272e965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d816b23-3900-4505-942d-e7dd1272e965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1944596515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf571a5-601a-499a-89d3-1024d3ab1b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5079efe115f845339dbc0c4758a2ed91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:27Z,use_quota=True,user_id='85d2ee643102473fa1eb4076d23c9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a4471d-651b-4218-b4f8-9b2d57b1bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a4471d-651b-4218-b4f8-9b2d57b1bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cf0482-befb-431c-8c4b-2298308584e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cf0482-befb-431c-8c4b-2298308584e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf571a5-601a-499a-89d3-1024d3ab1b50', 'volume_name': 'volume-ebf571a5-601a-499a-89d3-1024d3ab1b50', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45a17c6-0957-4682-9e07-0696ed6552c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45a17c6-0957-4682-9e07-0696ed6552c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f70669-f67c-4cb0-a407-7590f6e36532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:27 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Volume ebf571a5-601a-499a-89d3-1024d3ab1b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf571a5-601a-499a-89d3-1024d3ab1b50', 'volume_size': 1} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1944596515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf571a5-601a-499a-89d3-1024d3ab1b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5079efe115f845339dbc0c4758a2ed91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:27Z,use_quota=True,user_id='85d2ee643102473fa1eb4076d23c9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Creating volume ebf571a5-601a-499a-89d3-1024d3ab1b50 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:27:27 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:27:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:27 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 1073741824 Sep 01 11:27:27 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:28 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 1073741824" returned: 0 in 0.647s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:28 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 Sep 01 11:27:28 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:28 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50" returned: 0 in 0.374s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f70669-f67c-4cb0-a407-7590f6e36532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf571a5-601a-499a-89d3-1024d3ab1b50', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7915d3-9ea2-4768-88d1-4c991dea9415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:28 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Volume volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 (ebf571a5-601a-499a-89d3-1024d3ab1b50): created successfully Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7915d3-9ea2-4768-88d1-4c991dea9415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Flow 'volume_create_manager' (f601cd72-cbae-4f4f-b2ce-c6cec853e65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:28 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-79cdbd8f-1837-4711-b568-ba40291213e2 tempest-VolumesTransfersV355Test-1100391609 None] Created volume successfully. Sep 01 11:27:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Acquiring lock "cinder-ebf571a5-601a-499a-89d3-1024d3ab1b50-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-ebf571a5-601a-499a-89d3-1024d3ab1b50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Acquiring lock "cinder-quobyte-ebf571a5-601a-499a-89d3-1024d3ab1b50" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:27:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-quobyte-ebf571a5-601a-499a-89d3-1024d3ab1b50" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:27:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc55f37-5a9f-4ac3-9a08-c9ac7f16dc77]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:30 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 Sep 01 11:27:30 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:30 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50" returned: 0 in 0.495s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:30 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50 Sep 01 11:27:30 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:31 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ebf571a5-601a-499a-89d3-1024d3ab1b50" returned: 0 in 0.544s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-quobyte-ebf571a5-601a-499a-89d3-1024d3ab1b50" released by "delete_volume" :: held 1.128s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Created reservations ['04a23538-2223-4c66-b665-64c81924c4ce', 'ea7b0ce1-6dfa-488b-881c-da041a00ac4e', '2ffe7c7d-acf3-4623-b950-c9bf1396d7c8', '4aa0274b-9de5-46a6-a20f-827cad15ae6b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:31 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:27:31 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:31 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.528s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:31 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:27:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Deleted volume successfully. Sep 01 11:27:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d63f51d-3837-4081-82e7-c75b50b4bb98 tempest-VolumesTransfersV355Test-1034881605 None] Lock "cinder-ebf571a5-601a-499a-89d3-1024d3ab1b50-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:27:41 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=94,cinder:UPDATE=107,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:27:41 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=77,cinder:INSERT=30,cinder:UPDATE=115,cinder:DELETE=9 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Flow 'volume_create_manager' (07b55929-d072-4124-9bbc-990297c523ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b72cbb5-fdec-4631-a082-58bac1094bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b72cbb5-fdec-4631-a082-58bac1094bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-647087799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912d7807-b50f-4d30-8372-681711482063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00ba6786e9a4fd1b658a5be8ae6d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:57Z,use_quota=True,user_id='74d1d141f3c942e5b002b40761ceea78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16151f6f-3151-4d66-af07-9a45b6ae4c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16151f6f-3151-4d66-af07-9a45b6ae4c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b445f993-ecb4-42a2-b0a9-7d306ae9a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b445f993-ecb4-42a2-b0a9-7d306ae9a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912d7807-b50f-4d30-8372-681711482063', 'volume_name': 'volume-912d7807-b50f-4d30-8372-681711482063', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d817b0-7794-4474-8372-f4043f99e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d817b0-7794-4474-8372-f4043f99e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f5fa1-127c-4b8d-b8a7-4549590a77c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Volume 912d7807-b50f-4d30-8372-681711482063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912d7807-b50f-4d30-8372-681711482063', 'volume_size': 1} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-647087799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912d7807-b50f-4d30-8372-681711482063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00ba6786e9a4fd1b658a5be8ae6d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:27:57Z,use_quota=True,user_id='74d1d141f3c942e5b002b40761ceea78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Creating volume 912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:27:56 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:27:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:56 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 1073741824 Sep 01 11:27:56 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:57 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 1073741824" returned: 0 in 0.569s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:57 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 Sep 01 11:27:57 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:57 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063" returned: 0 in 0.309s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f5fa1-127c-4b8d-b8a7-4549590a77c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912d7807-b50f-4d30-8372-681711482063', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56e29e1-a5a1-4fec-a08b-899ba85d9458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:27:57 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Volume volume-912d7807-b50f-4d30-8372-681711482063 (912d7807-b50f-4d30-8372-681711482063): created successfully Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56e29e1-a5a1-4fec-a08b-899ba85d9458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:27:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Flow 'volume_create_manager' (07b55929-d072-4124-9bbc-990297c523ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:27:57 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8cf76cd2-81f7-432f-af69-43652e272b2e tempest-VolumesDeleteCascade-790212652 None] Created volume successfully. Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Creating offline snapshot b6780036-7598-44b0-8bf4-02b71e1223b1 of volume 912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546f268-2227-4d5d-a15e-7b7fa44bb8c3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:59 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 Sep 01 11:27:59 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:27:59 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063" returned: 0 in 0.608s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:27:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:27:59 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 1G Sep 01 11:27:59 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:00 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 1G" returned: 0 in 0.932s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912d7807-b50f-4d30-8372-681711482063 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:00 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912d7807-b50f-4d30-8372-681711482063 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:00 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:01 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912d7807-b50f-4d30-8372-681711482063 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.631s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:01 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 is being set with open permissions: ugo+rw Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:01 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:01 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Flow 'volume_create_manager' (60a16455-c336-44f8-b8d3-10a922e6b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea035f-324a-48cb-9b7f-4b56bd9c4e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea035f-324a-48cb-9b7f-4b56bd9c4e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689740653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e26213-9b35-4fbf-9d00-0f4af919c27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0630616fb6ba4435a6d4d0ce3b2871fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:01Z,use_quota=True,user_id='de01fbcb4d3c418185528e11af08dec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3d8bda-5a86-4953-9f0a-81ccbb45bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3d8bda-5a86-4953-9f0a-81ccbb45bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e5cf4a-1b9d-40d7-89cf-d324022da926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e5cf4a-1b9d-40d7-89cf-d324022da926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e26213-9b35-4fbf-9d00-0f4af919c27e', 'volume_name': 'volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34f2d8c-5be6-4747-ac6c-04ca9dad9adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34f2d8c-5be6-4747-ac6c-04ca9dad9adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed01bbe-9856-4b23-a24d-29c32d667262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Volume f0e26213-9b35-4fbf-9d00-0f4af919c27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e', 'volume_size': 1} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:01 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.463s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:01 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info Sep 01 11:28:01 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:02 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info" returned: 0 in 0.452s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:02 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info is being set with open permissions: ugo+rw Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:02 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info Sep 01 11:28:02 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Flow 'volume_create_manager' (882e6621-e6bd-44cb-af31-dd24decb90f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6f0e05-e231-4d8f-9dce-a3b10c4d851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6f0e05-e231-4d8f-9dce-a3b10c4d851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-331820041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228b4a3d902a496581b647519504dd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:02Z,use_quota=True,user_id='b6fef5f32f0f4e7bad81cb5d73104c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993162fc-4e26-4723-916e-1ff7de3a44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993162fc-4e26-4723-916e-1ff7de3a44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cdcfc8-03e7-43f9-b458-87e4ffc39f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cdcfc8-03e7-43f9-b458-87e4ffc39f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c', 'volume_name': 'volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46701afd-e71d-44df-ab53-4279d1572128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46701afd-e71d-44df-ab53-4279d1572128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcfa0b3-c75f-4990-a0a9-6f9006afb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:02 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Volume bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c', 'volume_size': 1} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:02 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.info" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.557s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689740653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e26213-9b35-4fbf-9d00-0f4af919c27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0630616fb6ba4435a6d4d0ce3b2871fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:01Z,use_quota=True,user_id='de01fbcb4d3c418185528e11af08dec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Creating volume f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:02 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1562b29d-4d54-42a7-bd26-8a69e5806f60 tempest-VolumesDeleteCascade-790212652 None] Create snapshot completed successfully Sep 01 11:28:02 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e 1073741824 Sep 01 11:28:02 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:03 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e 1073741824" returned: 0 in 0.540s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:03 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:28:03 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (fe72cfd7-6c04-4b6c-a316-a6d879e0f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5042b91-ce5d-4b9c-967c-70e3d359d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5042b91-ce5d-4b9c-967c-70e3d359d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2042940789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e164b904-d830-4dc8-b643-72e474c6a365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:04Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c347f9ee-f38c-47d4-8253-4f9435baf635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c347f9ee-f38c-47d4-8253-4f9435baf635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03909b45-896f-4540-bcfb-4b0b265b459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03909b45-896f-4540-bcfb-4b0b265b459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e164b904-d830-4dc8-b643-72e474c6a365', 'volume_name': 'volume-e164b904-d830-4dc8-b643-72e474c6a365', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10274d01-8384-48ea-add2-79f161cda459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10274d01-8384-48ea-add2-79f161cda459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052bb5a9-f9c4-4fab-bd54-8d7c6c0e1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:03 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Volume e164b904-d830-4dc8-b643-72e474c6a365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e164b904-d830-4dc8-b643-72e474c6a365', 'volume_size': 1} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:03 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.412s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.114s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-331820041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228b4a3d902a496581b647519504dd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:02Z,use_quota=True,user_id='b6fef5f32f0f4e7bad81cb5d73104c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Creating volume bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:03 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:03 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c 1073741824 Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed01bbe-9856-4b23-a24d-29c32d667262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:03 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11767e0-0d45-4cf0-bbbf-21a7ab7a4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:03 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Volume volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e (f0e26213-9b35-4fbf-9d00-0f4af919c27e): created successfully Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11767e0-0d45-4cf0-bbbf-21a7ab7a4191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Flow 'volume_create_manager' (60a16455-c336-44f8-b8d3-10a922e6b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:03 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-68c4417c-c605-4794-886f-9badcdec1967 tempest-VolumesActionsTest-968993080 None] Created volume successfully. Sep 01 11:28:04 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c 1073741824" returned: 0 in 0.471s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:04 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c Sep 01 11:28:04 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:04 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2042940789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e164b904-d830-4dc8-b643-72e474c6a365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:04Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Creating volume e164b904-d830-4dc8-b643-72e474c6a365 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:04 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:04 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 1073741824 Sep 01 11:28:04 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcfa0b3-c75f-4990-a0a9-6f9006afb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f208f580-5cb4-44ad-b166-69de2cb98028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:04 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Volume volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c (bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c): created successfully Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f208f580-5cb4-44ad-b166-69de2cb98028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:04 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:04 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Flow 'volume_create_manager' (882e6621-e6bd-44cb-af31-dd24decb90f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c8870ff8-fad9-4bb3-80ca-b5f19d9bc48b tempest-ServersNegativeTestJSON-2114878164 None] Created volume successfully. Sep 01 11:28:04 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.329s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:28:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:28:05 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 1073741824" returned: 0 in 0.633s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:05 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 Sep 01 11:28:05 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:05 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.758s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052bb5a9-f9c4-4fab-bd54-8d7c6c0e1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e164b904-d830-4dc8-b643-72e474c6a365', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380854fe-a47f-4721-adf2-bb1551320f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Creating offline snapshot 5dc4614a-e7de-4689-8d1b-e8ff00f86cff of volume 912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:28:05 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Volume volume-e164b904-d830-4dc8-b643-72e474c6a365 (e164b904-d830-4dc8-b643-72e474c6a365): created successfully Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380854fe-a47f-4721-adf2-bb1551320f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (fe72cfd7-6c04-4b6c-a316-a6d879e0f41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b37af8d-0760-490e-b588-be38349e845d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-dd320e9f-c6d9-43bb-9d11-2a89e00f3054 tempest-VolumesActionsTest-63781669 None] Created volume successfully. Sep 01 11:28:05 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:05 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:06 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.561s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-912d7807-b50f-4d30-8372-681711482063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:06 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff 1G Sep 01 11:28:06 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-005787fe-45a9-4523-8440-dd940fb6647c tempest-VolumesActionsTest-63781669 None] Acquiring lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365" by "attach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-005787fe-45a9-4523-8440-dd940fb6647c tempest-VolumesActionsTest-63781669 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365" acquired by "attach_volume" :: waited 0.038s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-005787fe-45a9-4523-8440-dd940fb6647c tempest-VolumesActionsTest-63781669 None] Attaching volume e164b904-d830-4dc8-b643-72e474c6a365 to instance 7844277b-9910-4ed0-933a-d815f2acfd16 at mountpoint /dev/vdb on host None. Sep 01 11:28:06 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-005787fe-45a9-4523-8440-dd940fb6647c tempest-VolumesActionsTest-63781669 None] Attach volume completed successfully. Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff 1G" returned: 0 in 0.738s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-005787fe-45a9-4523-8440-dd940fb6647c tempest-VolumesActionsTest-63781669 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365" released by "attach_volume" :: held 0.208s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:07 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff Sep 01 11:28:07 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:07 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff" returned: 0 in 0.663s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:07 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff is being set with open permissions: ugo+rw Sep 01 11:28:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:07 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff Sep 01 11:28:07 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:07 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff" returned: 0 in 0.380s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-52ab19f0-a780-4616-a396-a62c746a2fbb tempest-VolumesDeleteCascade-790212652 None] Create snapshot completed successfully Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Flow 'volume_create_manager' (69493289-9b94-4e4e-a3fb-aa11e4d45c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f79cc7-b6c2-4263-8ddc-d5169f9aa746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f79cc7-b6c2-4263-8ddc-d5169f9aa746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-551135514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf41f1e-2581-45ac-9b79-021d273bfb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228b4a3d902a496581b647519504dd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:08Z,use_quota=True,user_id='b6fef5f32f0f4e7bad81cb5d73104c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb954c1-8187-44d3-bb2f-3869c1be7d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb954c1-8187-44d3-bb2f-3869c1be7d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b854cd65-02a7-48ad-b1a4-27ffe41246cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b854cd65-02a7-48ad-b1a4-27ffe41246cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf41f1e-2581-45ac-9b79-021d273bfb62', 'volume_name': 'volume-ccf41f1e-2581-45ac-9b79-021d273bfb62', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2887e74f-c4f9-47c1-9216-374dbbb27f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2887e74f-c4f9-47c1-9216-374dbbb27f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43196c36-1d90-46fd-90ee-adf6ec67a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Volume ccf41f1e-2581-45ac-9b79-021d273bfb62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf41f1e-2581-45ac-9b79-021d273bfb62', 'volume_size': 1} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-551135514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf41f1e-2581-45ac-9b79-021d273bfb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228b4a3d902a496581b647519504dd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:08Z,use_quota=True,user_id='b6fef5f32f0f4e7bad81cb5d73104c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Creating volume ccf41f1e-2581-45ac-9b79-021d273bfb62 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:08 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:08 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 1073741824 Sep 01 11:28:08 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0eb6d37b-5829-40b9-a96e-b42d921ffbaa tempest-VolumesActionsTest-1494137042 None] Terminate volume connection completed successfully. Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb6d37b-5829-40b9-a96e-b42d921ffbaa tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-detach_volume" by "detach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb6d37b-5829-40b9-a96e-b42d921ffbaa tempest-VolumesActionsTest-1494137042 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0eb6d37b-5829-40b9-a96e-b42d921ffbaa tempest-VolumesActionsTest-1494137042 None] Detaching volume e164b904-d830-4dc8-b643-72e474c6a365 from instance 7844277b-9910-4ed0-933a-d815f2acfd16. Sep 01 11:28:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0eb6d37b-5829-40b9-a96e-b42d921ffbaa tempest-VolumesActionsTest-1494137042 None] Detach volume completed successfully. Sep 01 11:28:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb6d37b-5829-40b9-a96e-b42d921ffbaa tempest-VolumesActionsTest-1494137042 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-detach_volume" released by "detach_volume" :: held 0.168s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a3342ab-54d9-47ae-b0aa-4f8d1d9a5712 tempest-VolumesActionsTest-63781669 None] Acquiring lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-detach_volume" by "detach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a3342ab-54d9-47ae-b0aa-4f8d1d9a5712 tempest-VolumesActionsTest-63781669 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0a3342ab-54d9-47ae-b0aa-4f8d1d9a5712 tempest-VolumesActionsTest-63781669 None] Volume detach called, but volume not attached. Sep 01 11:28:09 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 1073741824" returned: 0 in 0.741s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a3342ab-54d9-47ae-b0aa-4f8d1d9a5712 tempest-VolumesActionsTest-63781669 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-912d7807-b50f-4d30-8372-681711482063-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-912d7807-b50f-4d30-8372-681711482063-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 Sep 01 11:28:09 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Performing cascade delete. {{(pid=87144) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-5dc4614a-e7de-4689-8d1b-e8ff00f86cff-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-5dc4614a-e7de-4689-8d1b-e8ff00f86cff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-5dc4614a-e7de-4689-8d1b-e8ff00f86cff" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62" returned: 0 in 0.340s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-5dc4614a-e7de-4689-8d1b-e8ff00f86cff" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Deleting offline snapshot 5dc4614a-e7de-4689-8d1b-e8ff00f86cff of volume 912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] snapshot_file for this snap is: volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Acquiring lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43196c36-1d90-46fd-90ee-adf6ec67a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf41f1e-2581-45ac-9b79-021d273bfb62', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ae2e04-6e67-4309-b766-0c938857581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d099490-0201-46ce-bf85-9b2d0c356a96]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:09 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Volume volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 (ccf41f1e-2581-45ac-9b79-021d273bfb62): created successfully Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ae2e04-6e67-4309-b766-0c938857581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Flow 'volume_create_manager' (69493289-9b94-4e4e-a3fb-aa11e4d45c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e3c9dd4f-d295-4845-833d-eb1122bbb120 tempest-ServersNegativeTestJSON-2114878164 None] Created volume successfully. Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Acquiring lock "cinder-quobyte-e164b904-d830-4dc8-b643-72e474c6a365" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Lock "cinder-quobyte-e164b904-d830-4dc8-b643-72e474c6a365" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9c622b-54d3-4201-afdb-46819ac840e3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:09 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff Sep 01 11:28:09 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:09 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 Sep 01 11:28:09 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:10 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff" returned: 0 in 0.678s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-912d7807-b50f-4d30-8372-681711482063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:28:10 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc58ee5-dbdb-45a8-80f0-8f04cf251fe4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:10 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365" returned: 0 in 0.724s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:10 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:10 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:10 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365 Sep 01 11:28:10 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "cinder-ccf41f1e-2581-45ac-9b79-021d273bfb62-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-ccf41f1e-2581-45ac-9b79-021d273bfb62-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:11 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:11 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e164b904-d830-4dc8-b643-72e474c6a365" returned: 0 in 0.562s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.717s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-912d7807-b50f-4d30-8372-681711482063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Lock "cinder-quobyte-e164b904-d830-4dc8-b643-72e474c6a365" released by "delete_volume" :: held 1.383s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:11 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff Sep 01 11:28:11 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "cinder-quobyte-ccf41f1e-2581-45ac-9b79-021d273bfb62" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-quobyte-ccf41f1e-2581-45ac-9b79-021d273bfb62" acquired by "delete_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77294b4-fd7c-4117-b63b-11cf8231c209]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Created reservations ['93f6fe53-63d3-4510-825e-819ac5060010', '923f3c75-2e1d-4014-bf40-80942390cb47', '14841b24-d8d4-4fcb-9568-6c0fb2dcae6e', 'c9faa305-ce3c-4f95-9c6d-a59f91113f47'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:11 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 Sep 01 11:28:11 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:11 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:11 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:11 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.534s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:11 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Deleted volume successfully. Sep 01 11:28:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-785f27e4-3c13-4523-b64d-14c4d89867bf tempest-VolumesActionsTest-63781669 None] Lock "cinder-e164b904-d830-4dc8-b643-72e474c6a365-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:12 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff" returned: 0 in 1.050s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:12 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62" returned: 0 in 0.969s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:12 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff Sep 01 11:28:12 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:12 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62 Sep 01 11:28:12 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:12 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ccf41f1e-2581-45ac-9b79-021d273bfb62" returned: 0 in 0.738s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:12 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.5dc4614a-e7de-4689-8d1b-e8ff00f86cff" returned: 0 in 0.854s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-quobyte-ccf41f1e-2581-45ac-9b79-021d273bfb62" released by "delete_volume" :: held 1.870s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-5dc4614a-e7de-4689-8d1b-e8ff00f86cff" released by "_delete_snapshot" :: held 3.611s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" released by "delete_snapshot" :: held 3.692s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Created reservations ['17350197-863e-4324-9e4e-10afeab85559', '5a195565-1929-4a29-8833-9927c95aca70', '74a1d1c8-21ab-4d15-ae0c-d66dc95f630c', 'e7576f66-f1dd-4cf5-9f87-c8b83672a032'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:13 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:13 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Created reservations ['297e035d-6e7f-4dbb-83da-dc63f6324ef8', '4f56eff6-242d-4bfa-bd91-e93d53af66cc', '90c26130-7598-4d97-bf31-0acd2c9275a7', '24057749-48e9-4d6d-8535-ca25110d0714'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "cinder-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Delete snapshot completed successfully. Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-5dc4614a-e7de-4689-8d1b-e8ff00f86cff-delete_snapshot" released by "delete_snapshot" :: held 4.227s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-b6780036-7598-44b0-8bf4-02b71e1223b1-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-b6780036-7598-44b0-8bf4-02b71e1223b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-b6780036-7598-44b0-8bf4-02b71e1223b1" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-b6780036-7598-44b0-8bf4-02b71e1223b1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Deleting offline snapshot b6780036-7598-44b0-8bf4-02b71e1223b1 of volume 912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] snapshot_file for this snap is: volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "cinder-quobyte-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f0902-5776-4f03-a681-75f2ea264f60]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-quobyte-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c" acquired by "delete_volume" :: waited 0.046s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ebf75-8e44-4c2a-a07f-caf5bc09c0c6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:13 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.600s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:13 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Deleted volume successfully. Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-26072fee-5e9a-467e-96dc-abf40b525575 tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-ccf41f1e-2581-45ac-9b79-021d273bfb62-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:14 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:14 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:14 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c Sep 01 11:28:14 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:14 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c" returned: 0 in 0.571s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:14 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c Sep 01 11:28:14 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:14 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.898s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-912d7807-b50f-4d30-8372-681711482063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee7f3d-ee84-4aec-966c-43f145e14753]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:15 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c" returned: 0 in 0.532s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-quobyte-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c" released by "delete_volume" :: held 1.176s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:15 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 Sep 01 11:28:15 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Created reservations ['1f65ba73-8d16-4b28-9107-3b83ff306139', '5f7331df-df54-462c-bd57-8bb666e5765e', 'bbc29f39-285e-4823-a32c-93a9abb9d639', '54dc1d0a-170a-4fbd-9207-83066728e099'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:15 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:15 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:15 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063" returned: 0 in 0.693s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:15 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:15 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:15 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.364s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Deleted volume successfully. Sep 01 11:28:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76cb313e-898e-4a70-979d-965c65abd10f tempest-ServersNegativeTestJSON-2114878164 None] Lock "cinder-bdbcb4cb-b0b2-4af6-8ed8-c9e4cba59f6c-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:16 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.455s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:16 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1 Sep 01 11:28:16 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eb517576-55b0-45ae-b2b1-7a18c359012a tempest-VolumesActionsTest-968993080 None] Acquiring lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e" by "attach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eb517576-55b0-45ae-b2b1-7a18c359012a tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e" acquired by "attach_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:16 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063.b6780036-7598-44b0-8bf4-02b71e1223b1" returned: 0 in 0.609s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-b6780036-7598-44b0-8bf4-02b71e1223b1" released by "_delete_snapshot" :: held 2.895s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" released by "delete_snapshot" :: held 2.960s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-eb517576-55b0-45ae-b2b1-7a18c359012a tempest-VolumesActionsTest-968993080 None] Attaching volume f0e26213-9b35-4fbf-9d00-0f4af919c27e to instance 5e2db764-ddf4-481c-a3ae-d61659fe5f43 at mountpoint /dev/vdb on host None. Sep 01 11:28:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-eb517576-55b0-45ae-b2b1-7a18c359012a tempest-VolumesActionsTest-968993080 None] Attach volume completed successfully. Sep 01 11:28:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eb517576-55b0-45ae-b2b1-7a18c359012a tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e" released by "attach_volume" :: held 0.335s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Created reservations ['5e37d60d-5112-48c5-87d1-6cd8d0b8bae6', 'f4461cda-f86a-4425-aba1-6c8a167ec420', '3d670800-5466-4372-9173-48809d820798', '39ddc358-2499-47c1-aa81-01053914be3c'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (e227b423-76f9-4e77-b3bd-59bc67ca7a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d0f295-b2d0-414e-a7f1-ef6f88f8c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d0f295-b2d0-414e-a7f1-ef6f88f8c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1760257150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c94325b-e43a-4a33-abb4-8aecdb925b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:17Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25262cf4-6b92-4bbc-ba4b-f397a25b6e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25262cf4-6b92-4bbc-ba4b-f397a25b6e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d06a954-02ad-4cd0-8114-372142155b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d06a954-02ad-4cd0-8114-372142155b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c94325b-e43a-4a33-abb4-8aecdb925b49', 'volume_name': 'volume-2c94325b-e43a-4a33-abb4-8aecdb925b49', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c35436-5854-4e6d-95bb-af0d9656a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c35436-5854-4e6d-95bb-af0d9656a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9539075-d321-43eb-a196-1541e07f2494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Volume 2c94325b-e43a-4a33-abb4-8aecdb925b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c94325b-e43a-4a33-abb4-8aecdb925b49', 'volume_size': 1} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1760257150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c94325b-e43a-4a33-abb4-8aecdb925b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:17Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Creating volume 2c94325b-e43a-4a33-abb4-8aecdb925b49 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:17 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d2f17843-9e5b-4e5c-8a74-94f2f2467f6c tempest-VolumesActionsTest-968993080 None] Acquiring lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-detach_volume" by "detach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:17 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 1073741824 Sep 01 11:28:17 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Delete snapshot completed successfully. Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d2f17843-9e5b-4e5c-8a74-94f2f2467f6c tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d2f17843-9e5b-4e5c-8a74-94f2f2467f6c tempest-VolumesActionsTest-968993080 None] Detaching volume f0e26213-9b35-4fbf-9d00-0f4af919c27e from instance 5e2db764-ddf4-481c-a3ae-d61659fe5f43. Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-b6780036-7598-44b0-8bf4-02b71e1223b1-delete_snapshot" released by "delete_snapshot" :: held 3.822s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Snapshots deleted, issuing volume delete {{(pid=87144) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" acquired by "delete_volume" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932392c-f7d8-448b-9376-1c83e386b33f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d2f17843-9e5b-4e5c-8a74-94f2f2467f6c tempest-VolumesActionsTest-968993080 None] Detach volume completed successfully. Sep 01 11:28:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d2f17843-9e5b-4e5c-8a74-94f2f2467f6c tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-detach_volume" released by "detach_volume" :: held 0.216s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:17 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 Sep 01 11:28:17 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:18 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 1073741824" returned: 0 in 0.909s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:18 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063" returned: 0 in 0.679s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:18 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063 Sep 01 11:28:18 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:18 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 Sep 01 11:28:18 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:18 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-912d7807-b50f-4d30-8372-681711482063" returned: 0 in 0.520s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-912d7807-b50f-4d30-8372-681711482063" released by "delete_volume" :: held 1.344s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:18 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49" returned: 0 in 0.541s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9539075-d321-43eb-a196-1541e07f2494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c94325b-e43a-4a33-abb4-8aecdb925b49', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511265c1-9612-41c4-bf61-7ae9e255293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:19 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Volume volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 (2c94325b-e43a-4a33-abb4-8aecdb925b49): created successfully Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511265c1-9612-41c4-bf61-7ae9e255293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (e227b423-76f9-4e77-b3bd-59bc67ca7a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b5c5bc27-bd37-4b8b-97c8-2ed9d5e5d9f2 tempest-VolumesActionsTest-63781669 None] Created volume successfully. Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Created reservations ['eaba450d-8988-406d-9881-3e9ec1b0d74d', '82b1fbeb-36f1-4dfd-8da1-a2f96f753b1d', 'e6791a9d-c6d0-4d0d-9e7d-917251bb7a33', 'e19c49a9-a431-4211-a31c-92a8e1631a97'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:19 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:19 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:19 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.265s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Deleted volume successfully. Sep 01 11:28:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-afd9fd4b-c212-4482-902d-2912fc902899 tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-912d7807-b50f-4d30-8372-681711482063-delete_volume" released by "delete_volume" :: held 10.308s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-2c94325b-e43a-4a33-abb4-8aecdb925b49-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Flow 'volume_create_manager' (8ca3eb18-fe50-4e4a-83a9-7370a1a9d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898268db-2b87-414f-85c1-cb59e038d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Lock "cinder-2c94325b-e43a-4a33-abb4-8aecdb925b49-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898268db-2b87-414f-85c1-cb59e038d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-414632323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5cce20-c855-43b3-a88e-8fd4d7fce438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00ba6786e9a4fd1b658a5be8ae6d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:20Z,use_quota=True,user_id='74d1d141f3c942e5b002b40761ceea78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b620e3bb-a105-401d-9021-51dde36b309f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b620e3bb-a105-401d-9021-51dde36b309f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582d0e9-2d94-485b-be9e-5d3c07ce5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582d0e9-2d94-485b-be9e-5d3c07ce5b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5cce20-c855-43b3-a88e-8fd4d7fce438', 'volume_name': 'volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16348acf-1d9d-4ddc-81d8-95fc5c0f903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16348acf-1d9d-4ddc-81d8-95fc5c0f903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1825bdef-6f82-4d56-a681-2b1a8976cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:20 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Volume 4c5cce20-c855-43b3-a88e-8fd4d7fce438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438', 'volume_size': 1} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-414632323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5cce20-c855-43b3-a88e-8fd4d7fce438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00ba6786e9a4fd1b658a5be8ae6d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:20Z,use_quota=True,user_id='74d1d141f3c942e5b002b40761ceea78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Creating volume 4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:20 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:20 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 1073741824 Sep 01 11:28:20 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-quobyte-2c94325b-e43a-4a33-abb4-8aecdb925b49" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-2c94325b-e43a-4a33-abb4-8aecdb925b49" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[603fae45-05fe-453f-8b08-005714710237]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:20 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 Sep 01 11:28:20 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:21 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 1073741824" returned: 0 in 0.624s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:21 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49" returned: 0 in 0.587s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:21 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:21 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:21 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49 Sep 01 11:28:21 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:21 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.283s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:21 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c94325b-e43a-4a33-abb4-8aecdb925b49" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1825bdef-6f82-4d56-a681-2b1a8976cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f193178f-2d52-49ec-a0f3-40108d8b24d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-2c94325b-e43a-4a33-abb4-8aecdb925b49" released by "delete_volume" :: held 0.940s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Volume volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 (4c5cce20-c855-43b3-a88e-8fd4d7fce438): created successfully Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f193178f-2d52-49ec-a0f3-40108d8b24d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Flow 'volume_create_manager' (8ca3eb18-fe50-4e4a-83a9-7370a1a9d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c893fe8a-5ddc-48f5-b422-37ab7f4d7dae tempest-VolumesDeleteCascade-790212652 None] Created volume successfully. Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Created reservations ['b81dde7e-e589-4d08-9110-8ad7328828b0', '4ba6baa1-a6ee-401f-80ce-2b80a1586ffb', '1579155f-d092-4697-8d62-ba3b4a6d5c92', '95578a94-412e-4de6-acd6-fec63425b5d1'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:21 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:21 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:22 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Deleted volume successfully. Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5201484-8263-4c1c-8bfb-060a66adf6aa tempest-VolumesActionsTest-1494137042 None] Lock "cinder-2c94325b-e43a-4a33-abb4-8aecdb925b49-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Creating offline snapshot 83a39439-1dfe-4498-b7da-d093a8905497 of volume 4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f95ba6-23aa-4073-b8f4-d8db83697a8c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:23 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:23 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:23 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.550s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:23 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 1G Sep 01 11:28:23 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (71354ec6-dc2a-4f57-b706-d45f938aff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dad6935-8775-4438-91c5-a20d25668963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dad6935-8775-4438-91c5-a20d25668963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23529654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe6e3b5-1d46-44fc-94b4-db884daa4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:24Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e54686-761b-459f-a999-aaa5732884d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e54686-761b-459f-a999-aaa5732884d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc2ce4c-7f3f-488e-83d5-dce43ae03bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc2ce4c-7f3f-488e-83d5-dce43ae03bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe6e3b5-1d46-44fc-94b4-db884daa4666', 'volume_name': 'volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47fbcfc-b4b3-4fee-82c7-37229345f521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47fbcfc-b4b3-4fee-82c7-37229345f521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4fe74b-dd25-43e0-aec5-8bc9597996ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Volume 9fe6e3b5-1d46-44fc-94b4-db884daa4666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666', 'volume_size': 1} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:23 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 1G" returned: 0 in 0.531s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:23 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 Sep 01 11:28:23 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:24 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497" returned: 0 in 0.437s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:24 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 is being set with open permissions: ugo+rw Sep 01 11:28:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:24 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 Sep 01 11:28:24 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:24 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497" returned: 0 in 0.367s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:24 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info Sep 01 11:28:24 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:25 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info" returned: 0 in 0.297s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:25 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info is being set with open permissions: ugo+rw Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:25 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info Sep 01 11:28:25 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:25 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.info" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.692s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23529654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe6e3b5-1d46-44fc-94b4-db884daa4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:24Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Creating volume 9fe6e3b5-1d46-44fc-94b4-db884daa4666 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:25 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:25 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 1073741824 Sep 01 11:28:25 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a0f880ef-257c-4798-bebe-97b45581d5e8 tempest-VolumesDeleteCascade-790212652 None] Create snapshot completed successfully Sep 01 11:28:26 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 1073741824" returned: 0 in 0.629s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:26 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 Sep 01 11:28:26 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:26 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666" returned: 0 in 0.347s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4fe74b-dd25-43e0-aec5-8bc9597996ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa3e17c-de2d-40c5-9ca9-fc3303d5036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:26 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Volume volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 (9fe6e3b5-1d46-44fc-94b4-db884daa4666): created successfully Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa3e17c-de2d-40c5-9ca9-fc3303d5036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (71354ec6-dc2a-4f57-b706-d45f938aff6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2853efba-2e79-4775-982c-5e01f407f4f6 tempest-VolumesActionsTest-63781669 None] Created volume successfully. Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Flow 'volume_create_manager' (77c1fcc6-f289-44a4-a75e-aed862ce683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5a2e14-348d-4d0c-ad11-e7d55bfd4228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5a2e14-348d-4d0c-ad11-e7d55bfd4228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-23539297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b81a4c9-6343-4054-95e3-21214ca11b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00ba6786e9a4fd1b658a5be8ae6d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83a39439-1dfe-4498-b7da-d093a8905497,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:27Z,use_quota=True,user_id='74d1d141f3c942e5b002b40761ceea78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2f7772-9eba-4db8-b7bb-e6a4c7969639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2f7772-9eba-4db8-b7bb-e6a4c7969639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a5a96-d7e2-42d1-9671-f4ebc0485a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a5a96-d7e2-42d1-9671-f4ebc0485a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b81a4c9-6343-4054-95e3-21214ca11b3a', 'volume_name': 'volume-6b81a4c9-6343-4054-95e3-21214ca11b3a', 'volume_size': 1, 'snapshot_id': '83a39439-1dfe-4498-b7da-d093a8905497'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e57f8-c022-44ed-b131-5e935585d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e57f8-c022-44ed-b131-5e935585d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbeb85dc-2f9e-4133-8e24-0a0045eecec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:26 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Volume 6b81a4c9-6343-4054-95e3-21214ca11b3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b81a4c9-6343-4054-95e3-21214ca11b3a', 'volume_size': 1, 'snapshot_id': '83a39439-1dfe-4498-b7da-d093a8905497'} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-83a39439-1dfe-4498-b7da-d093a8905497-6b81a4c9-6343-4054-95e3-21214ca11b3a" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-83a39439-1dfe-4498-b7da-d093a8905497-6b81a4c9-6343-4054-95e3-21214ca11b3a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Creating volume 6b81a4c9-6343-4054-95e3-21214ca11b3a from snapshot 83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-6b81a4c9-6343-4054-95e3-21214ca11b3a" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-6b81a4c9-6343-4054-95e3-21214ca11b3a" acquired by "_copy_volume_from_snapshot" :: waited 0.065s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] snapshot: 83a39439-1dfe-4498-b7da-d093a8905497, volume: 6b81a4c9-6343-4054-95e3-21214ca11b3a, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc6864-b34d-4ea9-9a2d-1209d3c03331]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-9fe6e3b5-1d46-44fc-94b4-db884daa4666-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-9fe6e3b5-1d46-44fc-94b4-db884daa4666-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:27 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 Sep 01 11:28:27 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-quobyte-9fe6e3b5-1d46-44fc-94b4-db884daa4666" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-9fe6e3b5-1d46-44fc-94b4-db884daa4666" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c4689d-a741-461d-a799-771fe03a1de4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:27 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497" returned: 0 in 0.711s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dc4bee-63e1-4a2e-bbce-4e9be95c8ca6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:27 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 Sep 01 11:28:27 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:28 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:28 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:28 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666" returned: 0 in 0.872s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:28 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666 Sep 01 11:28:28 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:28 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.839s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:28 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:28:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:28 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a Sep 01 11:28:28 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:29 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9fe6e3b5-1d46-44fc-94b4-db884daa4666" returned: 0 in 0.591s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-9fe6e3b5-1d46-44fc-94b4-db884daa4666" released by "delete_volume" :: held 1.592s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Created reservations ['e8fd9523-b054-4031-b3e1-02b5097f5e06', '4121e6c4-f936-4564-ba0a-336b7e07cdb7', 'daa5bdf6-3e98-42c0-918a-3ea4d8a474de', '80d3d9c8-75b8-4573-82b3-1d29e2e718cc'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:29 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:29 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:30 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.793s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:30 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Deleted volume successfully. Sep 01 11:28:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-762519e6-94ed-4402-8a13-04a542a009f3 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-9fe6e3b5-1d46-44fc-94b4-db884daa4666-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17a8f2a-a75e-44aa-9155-79367e6712f3 tempest-VolumesActionsTest-968993080 None] Acquiring lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e" by "attach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17a8f2a-a75e-44aa-9155-79367e6712f3 tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e" acquired by "attach_volume" :: waited 0.085s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (3bda6303-f4b2-47a7-936d-f9312ffdf9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025a0bbc-2e8b-446e-a62e-eba76fd8f010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025a0bbc-2e8b-446e-a62e-eba76fd8f010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1248843550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38214ed1-1fe1-493a-b735-ced2d6a4845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:32Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8659695a-3280-4d67-b5f5-582b0d470051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8659695a-3280-4d67-b5f5-582b0d470051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47571ff0-bf28-4772-a70d-e52a210390e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47571ff0-bf28-4772-a70d-e52a210390e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38214ed1-1fe1-493a-b735-ced2d6a4845b', 'volume_name': 'volume-38214ed1-1fe1-493a-b735-ced2d6a4845b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a152dacc-3d2a-4cde-b8af-238f4495a1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a152dacc-3d2a-4cde-b8af-238f4495a1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1808d7b-c647-44d6-8ac4-5950e0fa650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Volume 38214ed1-1fe1-493a-b735-ced2d6a4845b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38214ed1-1fe1-493a-b735-ced2d6a4845b', 'volume_size': 1} Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d17a8f2a-a75e-44aa-9155-79367e6712f3 tempest-VolumesActionsTest-968993080 None] Attaching volume f0e26213-9b35-4fbf-9d00-0f4af919c27e to instance 1cbce83b-772c-49ca-8081-b57d31d68f00 at mountpoint /dev/vdb on host None. Sep 01 11:28:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d17a8f2a-a75e-44aa-9155-79367e6712f3 tempest-VolumesActionsTest-968993080 None] Attach volume completed successfully. Sep 01 11:28:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d17a8f2a-a75e-44aa-9155-79367e6712f3 tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e" released by "attach_volume" :: held 0.740s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c45d020-74e7-4d49-ba61-ebcde58095bf tempest-VolumesActionsTest-968993080 None] Acquiring lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-detach_volume" by "detach_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c45d020-74e7-4d49-ba61-ebcde58095bf tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-detach_volume" acquired by "detach_volume" :: waited 0.076s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3c45d020-74e7-4d49-ba61-ebcde58095bf tempest-VolumesActionsTest-968993080 None] Detaching volume f0e26213-9b35-4fbf-9d00-0f4af919c27e from instance 1cbce83b-772c-49ca-8081-b57d31d68f00. Sep 01 11:28:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3c45d020-74e7-4d49-ba61-ebcde58095bf tempest-VolumesActionsTest-968993080 None] Detach volume completed successfully. Sep 01 11:28:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c45d020-74e7-4d49-ba61-ebcde58095bf tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-detach_volume" released by "detach_volume" :: held 0.227s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:36 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a" returned: 0 in 7.845s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:36 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa06c1-cc4c-4ec0-9a74-d3a2161d9976]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:36 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:36 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:37 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.764s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438, size 1024.00 MB, duration 7.85 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:28:37 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Converted 1024.00 MB image at 130.47 MB/s Sep 01 11:28:37 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a is being set with open permissions: ugo+rw Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:37 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a Sep 01 11:28:37 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:37 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a" returned: 0 in 0.254s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-6b81a4c9-6343-4054-95e3-21214ca11b3a" released by "_copy_volume_from_snapshot" :: held 10.669s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-83a39439-1dfe-4498-b7da-d093a8905497-6b81a4c9-6343-4054-95e3-21214ca11b3a" released by "_create_volume_from_snapshot" :: held 10.761s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.788s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.191s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1248843550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38214ed1-1fe1-493a-b735-ced2d6a4845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:32Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Creating volume 38214ed1-1fe1-493a-b735-ced2d6a4845b {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:28:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:37 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b 1073741824 Sep 01 11:28:37 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbeb85dc-2f9e-4133-8e24-0a0045eecec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b81a4c9-6343-4054-95e3-21214ca11b3a', 'volume_size': 1, 'snapshot_id': '83a39439-1dfe-4498-b7da-d093a8905497'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd650b5-3a5a-4aac-99a3-65cde88a4df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Volume volume-6b81a4c9-6343-4054-95e3-21214ca11b3a (6b81a4c9-6343-4054-95e3-21214ca11b3a): created successfully Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd650b5-3a5a-4aac-99a3-65cde88a4df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Flow 'volume_create_manager' (77c1fcc6-f289-44a4-a75e-aed862ce683c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e117b21d-b0a6-4892-9949-62884f19084a tempest-VolumesDeleteCascade-790212652 None] Created volume successfully. Sep 01 11:28:38 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b 1073741824" returned: 0 in 0.524s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:38 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b Sep 01 11:28:38 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-4c5cce20-c855-43b3-a88e-8fd4d7fce438-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:38 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-4c5cce20-c855-43b3-a88e-8fd4d7fce438-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1808d7b-c647-44d6-8ac4-5950e0fa650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38214ed1-1fe1-493a-b735-ced2d6a4845b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b21554-7295-41a9-9386-9d648dfe2518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Performing cascade delete. {{(pid=87144) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 11:28:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Volume volume-38214ed1-1fe1-493a-b735-ced2d6a4845b (38214ed1-1fe1-493a-b735-ced2d6a4845b): created successfully Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b21554-7295-41a9-9386-9d648dfe2518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (3bda6303-f4b2-47a7-936d-f9312ffdf9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-83a39439-1dfe-4498-b7da-d093a8905497-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0ef4e4b2-eed9-43fc-805d-57f7432accff tempest-VolumesActionsTest-63781669 None] Created volume successfully. Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-83a39439-1dfe-4498-b7da-d093a8905497-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-4c5cce20-c855-43b3-a88e-8fd4d7fce438" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-4c5cce20-c855-43b3-a88e-8fd4d7fce438" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-83a39439-1dfe-4498-b7da-d093a8905497" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-83a39439-1dfe-4498-b7da-d093a8905497" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Deleting offline snapshot 83a39439-1dfe-4498-b7da-d093a8905497 of volume 4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] snapshot_file for this snap is: volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caae16a-957b-4004-8abc-f5645bd50c87]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:38 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 Sep 01 11:28:38 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-38214ed1-1fe1-493a-b735-ced2d6a4845b-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-38214ed1-1fe1-493a-b735-ced2d6a4845b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-quobyte-38214ed1-1fe1-493a-b735-ced2d6a4845b" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:39 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497" returned: 0 in 0.553s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-38214ed1-1fe1-493a-b735-ced2d6a4845b" acquired by "delete_volume" :: waited 0.041s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8feff-22d3-4511-a341-c6ed61f143c3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6430881-2fcb-4e9c-b831-38d21a489724]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:39 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:39 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:39 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b Sep 01 11:28:39 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:39 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.419s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:39 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 Sep 01 11:28:39 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4991b0-1e9d-4cdb-8508-61294f312d7b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:39 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b" returned: 0 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:39 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b Sep 01 11:28:39 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:40 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:28:40 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:40 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-38214ed1-1fe1-493a-b735-ced2d6a4845b" returned: 0 in 0.300s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:40 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497" returned: 0 in 0.441s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-38214ed1-1fe1-493a-b735-ced2d6a4845b" released by "delete_volume" :: held 0.915s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:40 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497 Sep 01 11:28:40 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Created reservations ['1c71658b-7b09-4689-83a6-e59174bf8459', '936efb57-ea02-4b8d-afa0-7c61a1640d97', '4c3d27cc-c064-4ab3-8d12-5ed267999347', 'e10f3d6b-b444-4906-92f8-f5f453e53233'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:40 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.665s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:40 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:40 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afe2fbb-4bf2-478e-bbba-b5063767662f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:40 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438.83a39439-1dfe-4498-b7da-d093a8905497" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-83a39439-1dfe-4498-b7da-d093a8905497" released by "_delete_snapshot" :: held 1.993s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-4c5cce20-c855-43b3-a88e-8fd4d7fce438" released by "delete_snapshot" :: held 2.018s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:40 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:28:40 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Created reservations ['d15bc1bc-3e38-4a61-9436-409578c3dacb', 'fad8b85d-e761-4a6f-ac47-9e9d9b842620', '4831a146-4005-44bc-b1e7-6d2ccc098b24', 'bca0b679-af6e-44ff-a29b-e65d6dc0fe19'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:40 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Deleted volume successfully. Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2aceb614-520d-48ef-aef8-3bba539c7f05 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-38214ed1-1fe1-493a-b735-ced2d6a4845b-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Delete snapshot completed successfully. Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-83a39439-1dfe-4498-b7da-d093a8905497-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Snapshots deleted, issuing volume delete {{(pid=87144) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-4c5cce20-c855-43b3-a88e-8fd4d7fce438" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-4c5cce20-c855-43b3-a88e-8fd4d7fce438" acquired by "delete_volume" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e5396-51c1-4b71-8a07-e9ba6522dbc4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:41 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.07e286d0-0389-473f-b21d-ad24642ad0ce3sr619fv.img {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:41 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.07e286d0-0389-473f-b21d-ad24642ad0ce3sr619fv.img Sep 01 11:28:41 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:41 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:41 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:41 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.387s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:41 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438 Sep 01 11:28:41 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:42 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4c5cce20-c855-43b3-a88e-8fd4d7fce438" returned: 0 in 0.730s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-4c5cce20-c855-43b3-a88e-8fd4d7fce438" released by "delete_volume" :: held 1.225s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Created reservations ['6449a799-a0e0-4f18-8fda-54e92e0b9b11', 'ce096c57-9148-4aa7-a760-3de1d95155fd', '6321beb1-2741-49da-91e4-3cbde03249cb', '404c82b0-dabe-4c18-907e-d33a569097d7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:42 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:42 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (97f24fc4-accb-4951-8d3c-e3849cf51ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eca1806-080b-41b6-8e2b-0938044990e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eca1806-080b-41b6-8e2b-0938044990e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1788500602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb491f-507f-4937-a120-8b201e5309f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:43Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51a8699-d366-4e50-bf18-3e1739ad8d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51a8699-d366-4e50-bf18-3e1739ad8d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78653902-64bd-4c3a-a985-a80df42247c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78653902-64bd-4c3a-a985-a80df42247c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcb491f-507f-4937-a120-8b201e5309f3', 'volume_name': 'volume-5fcb491f-507f-4937-a120-8b201e5309f3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1582848-5971-44e5-8bf0-29dc1aa568f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1582848-5971-44e5-8bf0-29dc1aa568f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:43 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc211f0-f5b6-4315-b15f-3ae235e520f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Volume 5fcb491f-507f-4937-a120-8b201e5309f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcb491f-507f-4937-a120-8b201e5309f3', 'volume_size': 1} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.921s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Deleted volume successfully. Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8d876a9-5261-4316-a6e1-574bb7e48c5f tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-4c5cce20-c855-43b3-a88e-8fd4d7fce438-delete_volume" released by "delete_volume" :: held 4.976s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-6b81a4c9-6343-4054-95e3-21214ca11b3a-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-6b81a4c9-6343-4054-95e3-21214ca11b3a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "cinder-quobyte-6b81a4c9-6343-4054-95e3-21214ca11b3a" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:28:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-6b81a4c9-6343-4054-95e3-21214ca11b3a" acquired by "delete_volume" :: waited 0.062s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:28:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[48486b23-67a5-4299-b20a-29544faf537b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:44 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a Sep 01 11:28:44 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:45 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a" returned: 0 in 1.143s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:45 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a Sep 01 11:28:45 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:45 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b81a4c9-6343-4054-95e3-21214ca11b3a" returned: 0 in 0.717s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-quobyte-6b81a4c9-6343-4054-95e3-21214ca11b3a" released by "delete_volume" :: held 1.987s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Created reservations ['237cda9e-c8ec-4785-a458-37a54fae7e3e', '67c2249f-dbc2-4f54-8ffc-5f009019a9ed', 'aa414c7a-3932-471d-b99b-6852fb259482', '1211972b-6d37-458b-b677-969a4561df0f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:46 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:28:46 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:46 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.07e286d0-0389-473f-b21d-ad24642ad0ce3sr619fv.img" returned: 0 in 5.454s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d161ea-5d52-432f-87b6-f86275d55d48]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:28:46 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:28:46 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:28:46 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.331s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:28:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Deleted volume successfully. Sep 01 11:28:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d3bc3da8-d9c7-41ba-8b5f-0b16cee55cdd tempest-VolumesDeleteCascade-790212652 None] Lock "cinder-6b81a4c9-6343-4054-95e3-21214ca11b3a-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:28:47 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 01 11:28:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.629s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:28:47 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.07e286d0-0389-473f-b21d-ad24642ad0ce3sr619fv.img {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:28:47 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Converted 1024.00 MB image at 187.70 MB/s Sep 01 11:28:47 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] 07e286d0-0389-473f-b21d-ad24642ad0ce was raw, no need to convert to raw {{(pid=87144) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Flow 'volume_create_manager' (5b89717d-8da7-4445-8dfa-5f0e83f6b12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4979f804-91c4-4a22-b9f3-34bcb1b62467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4979f804-91c4-4a22-b9f3-34bcb1b62467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1320987045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f70cd-40ef-4971-b8a0-8bb7929a4a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e230e5f138b4c179191be45771d251c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:50Z,use_quota=True,user_id='276bf3bb9f6c4ea18210c280afea3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3246d245-d59d-4609-b773-06f460f4cd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3246d245-d59d-4609-b773-06f460f4cd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c313fc4-6f7a-461f-b429-1ae3328f53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c313fc4-6f7a-461f-b429-1ae3328f53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7f70cd-40ef-4971-b8a0-8bb7929a4a31', 'volume_name': 'volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33a5392-1cee-4784-8dd3-bb2096e234b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33a5392-1cee-4784-8dd3-bb2096e234b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccd3984-64c1-4812-ba71-7902b7d350fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:28:49 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Volume ed7f70cd-40ef-4971-b8a0-8bb7929a4a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31', 'volume_size': 1} Sep 01 11:28:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:28:59 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=116,cinder:UPDATE=143,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:28:59 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=122,cinder:SELECT=115,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:04 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:04 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:04 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.415s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:29:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.455s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Uploaded volume to glance image-id: 07e286d0-0389-473f-b21d-ad24642ad0ce. {{(pid=87144) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.854s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1788500602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb491f-507f-4937-a120-8b201e5309f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:43Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Creating volume 5fcb491f-507f-4937-a120-8b201e5309f3 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:10 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:10 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 1073741824 Sep 01 11:29:10 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-31a6826d-00f8-4476-a898-e373686d30c0 tempest-VolumesActionsTest-968993080 None] Copy volume to image completed successfully. Sep 01 11:29:10 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 1073741824" returned: 0 in 0.518s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:10 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 Sep 01 11:29:10 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:11 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.258s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1320987045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7f70cd-40ef-4971-b8a0-8bb7929a4a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e230e5f138b4c179191be45771d251c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:28:50Z,use_quota=True,user_id='276bf3bb9f6c4ea18210c280afea3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Creating volume ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:11 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc211f0-f5b6-4315-b15f-3ae235e520f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcb491f-507f-4937-a120-8b201e5309f3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:11 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 1073741824 Sep 01 11:29:11 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0976fdb6-5bcb-440f-bb9a-cb1956a350f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:11 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Volume volume-5fcb491f-507f-4937-a120-8b201e5309f3 (5fcb491f-507f-4937-a120-8b201e5309f3): created successfully Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0976fdb6-5bcb-440f-bb9a-cb1956a350f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (97f24fc4-accb-4951-8d3c-e3849cf51ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b6cf5f5f-b787-409d-b7d6-e11194bfd85e tempest-VolumesActionsTest-63781669 None] Created volume successfully. Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-5fcb491f-507f-4937-a120-8b201e5309f3-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-5fcb491f-507f-4937-a120-8b201e5309f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "cinder-quobyte-5fcb491f-507f-4937-a120-8b201e5309f3" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-5fcb491f-507f-4937-a120-8b201e5309f3" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:11 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b6eb55-0b09-486f-83ab-82b1e9c62a8f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 1073741824" returned: 0 in 0.687s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:11 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 Sep 01 11:29:12 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:12 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 Sep 01 11:29:12 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:12 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.237s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccd3984-64c1-4812-ba71-7902b7d350fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13819e2-5597-47ff-a08d-d4f5feca6fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1fc27e-47dc-45ed-b5c3-1d2e04b76f61]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:12 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Volume volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 (ed7f70cd-40ef-4971-b8a0-8bb7929a4a31): created successfully Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13819e2-5597-47ff-a08d-d4f5feca6fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Flow 'volume_create_manager' (5b89717d-8da7-4445-8dfa-5f0e83f6b12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e4566f97-55d5-4655-a6e0-1b1bac016b34 tempest-VolumesMetadataTest-1259453439 None] Created volume successfully. Sep 01 11:29:12 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3" returned: 0 in 0.528s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:12 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:29:12 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:12 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3 Sep 01 11:29:12 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:12 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5fcb491f-507f-4937-a120-8b201e5309f3" returned: 0 in 0.277s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:12 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-quobyte-5fcb491f-507f-4937-a120-8b201e5309f3" released by "delete_volume" :: held 0.890s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.411s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e9d0d-75ab-42e1-adc1-5bd2d3b1cada]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Created reservations ['1252854d-9b90-44dd-80b5-a73585c030c0', 'f3a72604-6625-4aa6-8a55-2cba41959969', '30636bc6-1608-4959-9619-97e5233ccf0e', '8f2f4f7e-654d-4c69-b7bd-8dd35a59ac66'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:12 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:29:12 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:12 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:12 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:13 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.371s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:13 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Deleted volume successfully. Sep 01 11:29:13 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.588s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4e539ab3-2303-49a9-8009-8f65f434c186 tempest-VolumesActionsTest-1494137042 None] Lock "cinder-5fcb491f-507f-4937-a120-8b201e5309f3-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:13 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img Sep 01 11:29:13 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (b34845ff-c9b8-4ea4-9935-967d71fd9f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfa8924-eeee-4563-aa01-99299552c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfa8924-eeee-4563-aa01-99299552c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003305267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63885aa-53f8-462f-81fe-6fc0ac9cec54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:14Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daea24e6-214e-4a39-807f-75a62d292e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daea24e6-214e-4a39-807f-75a62d292e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2c3c5e-4c9d-4c52-a48d-8fb27e4763fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2c3c5e-4c9d-4c52-a48d-8fb27e4763fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63885aa-53f8-462f-81fe-6fc0ac9cec54', 'volume_name': 'volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3f9a26-791c-4ff7-aaf4-0eabbeb58653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3f9a26-791c-4ff7-aaf4-0eabbeb58653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125074e6-5fe6-49b7-b055-554061a7e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:14 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Volume b63885aa-53f8-462f-81fe-6fc0ac9cec54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54', 'volume_size': 1} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Acquiring lock "cinder-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Lock "cinder-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Acquiring lock "cinder-quobyte-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Lock "cinder-quobyte-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ad50bc-6548-42e9-af43-d23b86d7d89f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:15 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 Sep 01 11:29:15 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:16 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31" returned: 0 in 1.171s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:16 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31 Sep 01 11:29:16 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:16 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31" returned: 0 in 0.488s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Lock "cinder-quobyte-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31" released by "delete_volume" :: held 1.764s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Created reservations ['35746457-d63e-466d-b0a1-38b4627065e0', '5db7c19e-eedc-4011-899e-c575d4f245a1', 'a286869d-c57d-41ce-96d8-e4868f601bca', 'a7f68355-6e39-473d-a132-6a5f9bca182b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:17 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:17 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:17 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.741s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:17 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Deleted volume successfully. Sep 01 11:29:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a7ff33b6-d622-49c4-ae60-72aa7a6b2e10 tempest-VolumesMetadataTest-1259453439 None] Lock "cinder-ed7f70cd-40ef-4971-b8a0-8bb7929a4a31-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:18 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img" returned: 0 in 5.156s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45ddeb-2795-46f9-9fe9-b7aaabb4f115]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:18 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:29:18 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:19 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.557s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:29:19 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Converted 1024.00 MB image at 198.57 MB/s Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] bc9d755c-0e20-4273-ab30-fb4c5b87e6d8 was raw, converting to qcow2 {{(pid=87144) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c9ccd-d775-4ca6-9a86-30e8ad737544]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:19 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img Sep 01 11:29:19 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:19 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img" returned: 0 in 0.355s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:19 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img Sep 01 11:29:19 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:19 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img" returned: 1 in 0.327s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:29:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img /opt/stack/data/cinder/conversion/vol_upload__f5tehqt {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:19 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img /opt/stack/data/cinder/conversion/vol_upload__f5tehqt Sep 01 11:29:19 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:20 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img /opt/stack/data/cinder/conversion/vol_upload__f5tehqt" returned: 0 in 0.254s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:20 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Image conversion details: src /opt/stack/data/cinder/conversion/f0e26213-9b35-4fbf-9d00-0f4af919c27e.temp_image.bc9d755c-0e20-4273-ab30-fb4c5b87e6d8ueswgfsj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__f5tehqt {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:29:20 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 11:29:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb4e80-b869-4ad0-a49c-40fef9721655]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__f5tehqt {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:20 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__f5tehqt Sep 01 11:29:20 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:20 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__f5tehqt" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.554s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Uploaded volume to glance image-id: bc9d755c-0e20-4273-ab30-fb4c5b87e6d8. {{(pid=87144) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.305s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003305267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63885aa-53f8-462f-81fe-6fc0ac9cec54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e62636304624c51a7816b6e26474b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:14Z,use_quota=True,user_id='67839fd3d88d4cc3a87485738c911341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Creating volume b63885aa-53f8-462f-81fe-6fc0ac9cec54 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:21 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:21 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 1073741824 Sep 01 11:29:21 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9c07db7c-c876-4796-bcfd-0a91a600aa1c tempest-VolumesActionsTest-968993080 None] Copy volume to image completed successfully. Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Flow 'volume_create_manager' (b2176aac-8103-41f2-ba2a-95833ef63ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc53d5a-1cdc-4fba-8e69-d0576e6c0eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc53d5a-1cdc-4fba-8e69-d0576e6c0eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2059315047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec888a3d-7c8b-4941-9a16-187c5469d9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca24057e84e34696bfc4b38a4a22fa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:22Z,use_quota=True,user_id='a6250630b5f34b07a63682fdf79c9c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ae506e-7248-4252-b421-8af1093b85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:22 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ae506e-7248-4252-b421-8af1093b85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83fcfdd-f7a5-4df8-b807-afe5b91beed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83fcfdd-f7a5-4df8-b807-afe5b91beed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec888a3d-7c8b-4941-9a16-187c5469d9a3', 'volume_name': 'volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931ad05c-9fe4-45f2-a7cb-96146ba8d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931ad05c-9fe4-45f2-a7cb-96146ba8d0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c5dd61-5a76-46ed-8d81-1e86b7738787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Volume ec888a3d-7c8b-4941-9a16-187c5469d9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3', 'volume_size': 1} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 1073741824" returned: 0 in 0.585s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:22 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 Sep 01 11:29:22 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:22 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54" returned: 0 in 0.251s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2059315047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec888a3d-7c8b-4941-9a16-187c5469d9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca24057e84e34696bfc4b38a4a22fa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:22Z,use_quota=True,user_id='a6250630b5f34b07a63682fdf79c9c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Creating volume ec888a3d-7c8b-4941-9a16-187c5469d9a3 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:22 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125074e6-5fe6-49b7-b055-554061a7e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7c442e-6a7d-4604-9b76-87d8605bc1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:22 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 1073741824 Sep 01 11:29:22 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Volume volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 (b63885aa-53f8-462f-81fe-6fc0ac9cec54): created successfully Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7c442e-6a7d-4604-9b76-87d8605bc1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Flow 'volume_create_manager' (b34845ff-c9b8-4ea4-9935-967d71fd9f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d72358fb-06f7-46ff-b0c9-a4b5d4ba1f1b tempest-VolumesActionsTest-63781669 None] Created volume successfully. Sep 01 11:29:23 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 1073741824" returned: 0 in 0.477s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:23 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 Sep 01 11:29:23 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:23 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3" returned: 0 in 0.289s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c5dd61-5a76-46ed-8d81-1e86b7738787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a94235-c4c7-49cf-9cd1-76d4d0215bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Volume volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 (ec888a3d-7c8b-4941-9a16-187c5469d9a3): created successfully Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a94235-c4c7-49cf-9cd1-76d4d0215bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Flow 'volume_create_manager' (b2176aac-8103-41f2-ba2a-95833ef63ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Acquiring lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a53719a4-bad0-4dc5-9427-1fd01dcf123b tempest-VolumesTransfersTest-458640157 None] Created volume successfully. Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Acquiring lock "cinder-quobyte-f0e26213-9b35-4fbf-9d00-0f4af919c27e" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Lock "cinder-quobyte-f0e26213-9b35-4fbf-9d00-0f4af919c27e" acquired by "delete_volume" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6994ef-57f9-4027-bc35-fbfe80ec1873]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:23 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:29:23 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:24 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.473s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:24 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e Sep 01 11:29:24 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:24 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0e26213-9b35-4fbf-9d00-0f4af919c27e" returned: 0 in 0.318s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Lock "cinder-quobyte-f0e26213-9b35-4fbf-9d00-0f4af919c27e" released by "delete_volume" :: held 0.849s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Created reservations ['b628bc06-9165-4e5c-be57-c85cf2960eb2', '4ef52d24-eae9-4501-afec-ae1e506d8c90', '9fc9ce09-166d-4e53-b761-34ce0bdf685f', '67c7b7d8-89c8-4b94-bfd6-dc16b1e5457e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Acquiring lock "cinder-b63885aa-53f8-462f-81fe-6fc0ac9cec54-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Lock "cinder-b63885aa-53f8-462f-81fe-6fc0ac9cec54-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Acquiring lock "cinder-quobyte-b63885aa-53f8-462f-81fe-6fc0ac9cec54" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:24 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Lock "cinder-quobyte-b63885aa-53f8-462f-81fe-6fc0ac9cec54" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:24 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a013ec47-edb5-463a-a08b-eec7bae0a0f5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:24 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 Sep 01 11:29:24 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:25 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Deleted volume successfully. Sep 01 11:29:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2e64546b-8457-46b6-b4cb-80b0691a81ca tempest-VolumesTransfersTest-206373212 None] Transfer volume completed successfully. Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4da6eb9b-5a20-44bd-aeb2-015c71dc3f52 tempest-VolumesActionsTest-968993080 None] Lock "cinder-f0e26213-9b35-4fbf-9d00-0f4af919c27e-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:25 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Flow 'volume_create_manager' (9fb7aafc-5eba-4f73-8a13-b92c6d504193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34514674-a542-4595-92da-30280228e70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54" returned: 0 in 0.605s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34514674-a542-4595-92da-30280228e70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2117970124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc00e13-afd8-4133-aef0-3358b210866d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401cfcd5f5654e808cb063f645dc6369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:25Z,use_quota=True,user_id='a64eba536af348a1b570dc3149e11c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:25 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54 Sep 01 11:29:25 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c17bf5-8164-48ec-9203-a246830dcfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c17bf5-8164-48ec-9203-a246830dcfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cfde94-642a-43fd-b7ab-efd6a436118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cfde94-642a-43fd-b7ab-efd6a436118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc00e13-afd8-4133-aef0-3358b210866d', 'volume_name': 'volume-6dc00e13-afd8-4133-aef0-3358b210866d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb36c97b-2d60-41d0-ba74-051bb4857e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb36c97b-2d60-41d0-ba74-051bb4857e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7218cd-01ca-40f2-90d0-34195bf65b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:25 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Volume 6dc00e13-afd8-4133-aef0-3358b210866d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc00e13-afd8-4133-aef0-3358b210866d', 'volume_size': 1} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2117970124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc00e13-afd8-4133-aef0-3358b210866d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401cfcd5f5654e808cb063f645dc6369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:25Z,use_quota=True,user_id='a64eba536af348a1b570dc3149e11c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Creating volume 6dc00e13-afd8-4133-aef0-3358b210866d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:25 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:25 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d 1073741824 Sep 01 11:29:25 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:25 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b63885aa-53f8-462f-81fe-6fc0ac9cec54" returned: 0 in 0.277s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Lock "cinder-quobyte-b63885aa-53f8-462f-81fe-6fc0ac9cec54" released by "delete_volume" :: held 0.944s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Acquiring lock "cinder-ec888a3d-7c8b-4941-9a16-187c5469d9a3-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Created reservations ['a522183e-3e37-4ee1-a082-6a30b1c9e666', '6f2270f4-9b65-48c1-ad76-8a968871c6f6', 'b3072217-66ea-42ef-bff4-903e79617dcb', '3d46d8d9-3ce7-4b9d-a70d-cdcf3895ca51'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Lock "cinder-ec888a3d-7c8b-4941-9a16-187c5469d9a3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Acquiring lock "cinder-quobyte-ec888a3d-7c8b-4941-9a16-187c5469d9a3" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Lock "cinder-quobyte-ec888a3d-7c8b-4941-9a16-187c5469d9a3" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e286b8c6-5084-459b-a52e-439cd7bad27a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:25 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:25 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:26 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 Sep 01 11:29:26 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:26 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d 1073741824" returned: 0 in 0.632s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:26 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d Sep 01 11:29:26 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:26 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.400s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Deleted volume successfully. Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8d456847-b9fe-4dc8-aa22-30b350debe63 tempest-VolumesActionsTest-63781669 None] Lock "cinder-b63885aa-53f8-462f-81fe-6fc0ac9cec54-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:26 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3" returned: 0 in 0.547s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:26 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3 Sep 01 11:29:26 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:26 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d" returned: 0 in 0.416s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7218cd-01ca-40f2-90d0-34195bf65b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc00e13-afd8-4133-aef0-3358b210866d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d300ce0d-35ac-49af-a498-be66bda213af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:26 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Volume volume-6dc00e13-afd8-4133-aef0-3358b210866d (6dc00e13-afd8-4133-aef0-3358b210866d): created successfully Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d300ce0d-35ac-49af-a498-be66bda213af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Flow 'volume_create_manager' (9fb7aafc-5eba-4f73-8a13-b92c6d504193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-029410eb-2779-42a3-a049-7c75505a8966 tempest-AttachVolumeNegativeTest-911563986 None] Created volume successfully. Sep 01 11:29:26 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ec888a3d-7c8b-4941-9a16-187c5469d9a3" returned: 0 in 0.288s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Lock "cinder-quobyte-ec888a3d-7c8b-4941-9a16-187c5469d9a3" released by "delete_volume" :: held 0.920s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Created reservations ['2dc2e117-1e32-43f6-a856-eb9b0de40f35', 'e7e66ac7-35bb-4ac5-abbb-e095d2e69ff2', '727531df-af88-492e-b139-c84a63d6badd', '534332cf-462d-4929-8d28-850cd3f7a954'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:26 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:26 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:27 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.307s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:27 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Deleted volume successfully. Sep 01 11:29:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e455ab53-5335-4d20-8ed5-601211e9845d tempest-VolumesTransfersTest-354800109 None] Lock "cinder-ec888a3d-7c8b-4941-9a16-187c5469d9a3-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a0fa66-9da2-4fc9-bebb-711324d1b6a7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:28 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d Sep 01 11:29:28 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Flow 'volume_create_manager' (33b61500-8c5a-4a9e-ac66-e6520cad9d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb345733-dc10-4f52-8d5d-6e2ee3a5cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb345733-dc10-4f52-8d5d-6e2ee3a5cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1797283277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ff56e5-92b8-4bce-9238-366234fb3dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca24057e84e34696bfc4b38a4a22fa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:29Z,use_quota=True,user_id='a6250630b5f34b07a63682fdf79c9c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c193908c-d1e1-4613-8586-85f3caa04977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c193908c-d1e1-4613-8586-85f3caa04977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0237eaca-16dc-4b96-82d7-1ce22098638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0237eaca-16dc-4b96-82d7-1ce22098638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ff56e5-92b8-4bce-9238-366234fb3dd3', 'volume_name': 'volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703c5822-8511-4d78-84c4-f9d3556c6486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703c5822-8511-4d78-84c4-f9d3556c6486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1e5511-ca41-41b8-96db-9482447aa526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:28 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Volume c6ff56e5-92b8-4bce-9238-366234fb3dd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3', 'volume_size': 1} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:28 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d" returned: 0 in 0.431s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.469s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1797283277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ff56e5-92b8-4bce-9238-366234fb3dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca24057e84e34696bfc4b38a4a22fa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:29Z,use_quota=True,user_id='a6250630b5f34b07a63682fdf79c9c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Creating volume c6ff56e5-92b8-4bce-9238-366234fb3dd3 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:28 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:28 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 1073741824 Sep 01 11:29:28 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-6dc00e13-afd8-4133-aef0-3358b210866d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba3790d8-c176-4550-adc6-9e4ac8726b27', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:29:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-27b9733e-0c5d-4fd3-9354-8a090125f5d0 req-5dab5591-89c8-4a3b-9427-cf7f4d0c27c3 tempest-AttachVolumeNegativeTest-911563986 None] attachment_update completed successfully. Sep 01 11:29:29 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 1073741824" returned: 0 in 0.694s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:29 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 Sep 01 11:29:29 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:30 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3" returned: 0 in 0.297s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1e5511-ca41-41b8-96db-9482447aa526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f828a9-6c99-4867-bd49-e4a85149bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Volume volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 (c6ff56e5-92b8-4bce-9238-366234fb3dd3): created successfully Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f828a9-6c99-4867-bd49-e4a85149bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Flow 'volume_create_manager' (33b61500-8c5a-4a9e-ac66-e6520cad9d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-38919389-720b-40a6-95dc-339ac51e3ba6 tempest-VolumesTransfersTest-458640157 None] Created volume successfully. Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Acquiring lock "cinder-c6ff56e5-92b8-4bce-9238-366234fb3dd3-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Lock "cinder-c6ff56e5-92b8-4bce-9238-366234fb3dd3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Acquiring lock "cinder-quobyte-c6ff56e5-92b8-4bce-9238-366234fb3dd3" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Lock "cinder-quobyte-c6ff56e5-92b8-4bce-9238-366234fb3dd3" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6f390-150b-47d0-ab93-7ea6b760bd1e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:31 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 Sep 01 11:29:31 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:31 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3" returned: 0 in 0.459s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:31 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3 Sep 01 11:29:31 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:32 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c6ff56e5-92b8-4bce-9238-366234fb3dd3" returned: 0 in 0.325s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Lock "cinder-quobyte-c6ff56e5-92b8-4bce-9238-366234fb3dd3" released by "delete_volume" :: held 0.837s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Created reservations ['5e11a6b6-a34e-47f5-8dd0-078d7ccfd606', 'b256223e-e91f-4e96-8a75-16635cd7f954', '909713d6-b691-43e8-90ed-06ac8aa52912', 'ca1e6e1f-f0cb-4e9a-ab83-7ea804ca5623'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:32 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:32 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:32 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Deleted volume successfully. Sep 01 11:29:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20ec9db9-e462-47ed-9b02-c7e216457d51 tempest-VolumesTransfersTest-354800109 None] Lock "cinder-c6ff56e5-92b8-4bce-9238-366234fb3dd3-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Flow 'volume_create_manager' (38b37788-7750-4ce7-a45d-cfff670304a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafa4834-9631-45e8-a164-5a6d53f51c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafa4834-9631-45e8-a164-5a6d53f51c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-890789692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa327cd-a387-42f6-8712-4efd5d998180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516b7857f64044ad84922fa7d30a1c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:35Z,use_quota=True,user_id='96c3afae07e84af796d0e95d47f45632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a52b11-6861-4ccb-bcb7-697cc71746a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a52b11-6861-4ccb-bcb7-697cc71746a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65a8798-1e22-45ba-8a05-acfa066cdb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65a8798-1e22-45ba-8a05-acfa066cdb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa327cd-a387-42f6-8712-4efd5d998180', 'volume_name': 'volume-eaa327cd-a387-42f6-8712-4efd5d998180', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f0d703-2a69-4d51-b4cc-13db44b838ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f0d703-2a69-4d51-b4cc-13db44b838ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dbf305-9d8b-49b3-808d-fd38a95ac04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:34 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Volume eaa327cd-a387-42f6-8712-4efd5d998180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa327cd-a387-42f6-8712-4efd5d998180', 'volume_size': 1} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-890789692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa327cd-a387-42f6-8712-4efd5d998180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516b7857f64044ad84922fa7d30a1c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:35Z,use_quota=True,user_id='96c3afae07e84af796d0e95d47f45632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Creating volume eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:34 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:35 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 1073741824 Sep 01 11:29:35 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:35 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 1073741824" returned: 0 in 0.606s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:35 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:35 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:35 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.282s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dbf305-9d8b-49b3-808d-fd38a95ac04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa327cd-a387-42f6-8712-4efd5d998180', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68ce166-d8ac-4daa-bb3f-4edf4b2fde78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Volume volume-eaa327cd-a387-42f6-8712-4efd5d998180 (eaa327cd-a387-42f6-8712-4efd5d998180): created successfully Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68ce166-d8ac-4daa-bb3f-4edf4b2fde78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Flow 'volume_create_manager' (38b37788-7750-4ce7-a45d-cfff670304a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9ceaf29f-3075-49d8-bd5c-5454674521be tempest-VolumesCloneTest-564915104 None] Created volume successfully. Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Flow 'volume_create_manager' (7223907b-c6d4-40aa-ace9-165c01488f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e74636-2a3c-4436-835e-55947d0385b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e74636-2a3c-4436-835e-55947d0385b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-887298427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d2dd10-353f-4409-8f37-77dae02320f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516b7857f64044ad84922fa7d30a1c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eaa327cd-a387-42f6-8712-4efd5d998180,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:38Z,use_quota=True,user_id='96c3afae07e84af796d0e95d47f45632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e77c2e-baee-4542-ac6a-75e8ed388219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e77c2e-baee-4542-ac6a-75e8ed388219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b93d56e-3581-4cc7-8aec-71dc267dd4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b93d56e-3581-4cc7-8aec-71dc267dd4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '46d2dd10-353f-4409-8f37-77dae02320f1', 'volume_name': 'volume-46d2dd10-353f-4409-8f37-77dae02320f1', 'volume_size': 2, 'source_volid': 'eaa327cd-a387-42f6-8712-4efd5d998180', 'source_volstatus': 'available'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9ce6a5-c7fc-4667-8397-1df80d783008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9ce6a5-c7fc-4667-8397-1df80d783008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f6faf7-e4de-4eb1-aecc-bb024cbe5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Volume 46d2dd10-353f-4409-8f37-77dae02320f1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-46d2dd10-353f-4409-8f37-77dae02320f1', 'volume_size': 2, 'source_volid': 'eaa327cd-a387-42f6-8712-4efd5d998180', 'source_volstatus': 'available'} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:38 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Cloning volume eaa327cd-a387-42f6-8712-4efd5d998180 to volume 46d2dd10-353f-4409-8f37-77dae02320f1 Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Creating offline snapshot 4fead084-2da4-43c1-82e5-12ff363ff181 of volume eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[da67217b-d877-4946-abfb-a426d8297e86]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:38 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:38 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:39 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.729s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:39 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 1G Sep 01 11:29:39 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:39 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 1G" returned: 0 in 0.637s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa327cd-a387-42f6-8712-4efd5d998180 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:39 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa327cd-a387-42f6-8712-4efd5d998180 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 Sep 01 11:29:39 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:40 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa327cd-a387-42f6-8712-4efd5d998180 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181" returned: 0 in 0.447s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:40 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 is being set with open permissions: ugo+rw Sep 01 11:29:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:40 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 Sep 01 11:29:40 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:40 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:40 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info Sep 01 11:29:40 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:40 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info" returned: 0 in 0.352s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:40 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info is being set with open permissions: ugo+rw Sep 01 11:29:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:40 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info Sep 01 11:29:40 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:41 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.info" returned: 0 in 0.358s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Acquiring lock "cinder-quobyte-46d2dd10-353f-4409-8f37-77dae02320f1" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-46d2dd10-353f-4409-8f37-77dae02320f1" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] snapshot: 4fead084-2da4-43c1-82e5-12ff363ff181, volume: 46d2dd10-353f-4409-8f37-77dae02320f1, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[943fe898-32dc-4eab-a28e-bf822e59e304]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:41 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 Sep 01 11:29:41 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:41 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181" returned: 0 in 0.423s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa327cd-a387-42f6-8712-4efd5d998180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700ba4d-844d-4f4d-95d6-513ecedadae8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:41 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:41 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:42 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.805s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:42 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:29:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:42 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 Sep 01 11:29:42 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Flow 'volume_create_manager' (4b183dc9-c31e-4761-8915-9f953c158951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cdd880-e76f-4deb-84c4-5f16ab0cac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cdd880-e76f-4deb-84c4-5f16ab0cac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-768606232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7406686d-f99b-4f19-95fd-8fef231e1814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2633d7588b1400897918bbf341a7020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:48Z,use_quota=True,user_id='bf9c5f2a5ffb4b8a8915f96c6a40d6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3236d2bb-eb3b-4d19-bce8-247d2942aab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3236d2bb-eb3b-4d19-bce8-247d2942aab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27e3b83-3b35-46e7-92bd-d4528ab8154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27e3b83-3b35-46e7-92bd-d4528ab8154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7406686d-f99b-4f19-95fd-8fef231e1814', 'volume_name': 'volume-7406686d-f99b-4f19-95fd-8fef231e1814', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0fda6c-a189-4cbf-b5c3-08861cf60939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0fda6c-a189-4cbf-b5c3-08861cf60939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cddad2-07f0-46cc-ab2c-68f4e1f42291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Volume 7406686d-f99b-4f19-95fd-8fef231e1814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7406686d-f99b-4f19-95fd-8fef231e1814', 'volume_size': 1} Sep 01 11:29:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:50 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1" returned: 0 in 7.739s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dee3b1-b45e-4456-bad2-bcc4b31ec7b7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:50 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:50 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:51 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.763s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:29:51 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Converted 1024.00 MB image at 132.30 MB/s Sep 01 11:29:51 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 is being set with open permissions: ugo+rw Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:51 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 Sep 01 11:29:51 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:51 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1" returned: 0 in 0.352s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-46d2dd10-353f-4409-8f37-77dae02320f1" released by "_copy_volume_from_snapshot" :: held 10.199s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Acquiring lock "cinder-quobyte-4fead084-2da4-43c1-82e5-12ff363ff181" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-4fead084-2da4-43c1-82e5-12ff363ff181" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Deleting offline snapshot 4fead084-2da4-43c1-82e5-12ff363ff181 of volume eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] snapshot_file for this snap is: volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[209fcaf8-3d8c-43c6-8f19-16eb4c930c0e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:51 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 Sep 01 11:29:51 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:51 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181" returned: 0 in 0.412s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa327cd-a387-42f6-8712-4efd5d998180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b575a80-d5ec-461a-886f-26f65e6ea873]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:52 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:52 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:52 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.393s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:52 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 Sep 01 11:29:52 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:52 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181" returned: 0 in 0.382s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:52 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181 Sep 01 11:29:52 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:52 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180.4fead084-2da4-43c1-82e5-12ff363ff181" returned: 0 in 0.284s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-4fead084-2da4-43c1-82e5-12ff363ff181" released by "_delete_snapshot" :: held 1.592s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.900s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.679s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-768606232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7406686d-f99b-4f19-95fd-8fef231e1814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2633d7588b1400897918bbf341a7020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:48Z,use_quota=True,user_id='bf9c5f2a5ffb4b8a8915f96c6a40d6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Creating volume 7406686d-f99b-4f19-95fd-8fef231e1814 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:53 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f6faf7-e4de-4eb1-aecc-bb024cbe5fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d2dd10-353f-4409-8f37-77dae02320f1', 'volume_size': 2, 'source_volid': 'eaa327cd-a387-42f6-8712-4efd5d998180', 'source_volstatus': 'available'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:53 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 1073741824 Sep 01 11:29:53 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dee3c0d-1cee-43dc-99f6-f8703e979b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:53 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Volume volume-46d2dd10-353f-4409-8f37-77dae02320f1 (46d2dd10-353f-4409-8f37-77dae02320f1): created successfully Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dee3c0d-1cee-43dc-99f6-f8703e979b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Flow 'volume_create_manager' (7223907b-c6d4-40aa-ace9-165c01488f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ac324cdc-13ce-4123-b7cc-d6b16a6fe91b tempest-VolumesCloneTest-564915104 None] Created volume successfully. Sep 01 11:29:53 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 1073741824" returned: 0 in 0.529s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:53 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 Sep 01 11:29:53 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:53 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814" returned: 0 in 0.269s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cddad2-07f0-46cc-ab2c-68f4e1f42291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7406686d-f99b-4f19-95fd-8fef231e1814', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9757b63-1c64-4929-9b21-79dc313aaf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:53 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Volume volume-7406686d-f99b-4f19-95fd-8fef231e1814 (7406686d-f99b-4f19-95fd-8fef231e1814): created successfully Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9757b63-1c64-4929-9b21-79dc313aaf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Flow 'volume_create_manager' (4b183dc9-c31e-4761-8915-9f953c158951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-eb2c29bf-9310-401f-92a7-a38e2b80d0f5 tempest-VolumesListAdminTestJSON-1931786820 None] Created volume successfully. Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Acquiring lock "cinder-46d2dd10-353f-4409-8f37-77dae02320f1-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Lock "cinder-46d2dd10-353f-4409-8f37-77dae02320f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Acquiring lock "cinder-quobyte-46d2dd10-353f-4409-8f37-77dae02320f1" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-46d2dd10-353f-4409-8f37-77dae02320f1" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82b8277-64a1-4a03-8f18-9e92804becf6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:54 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 Sep 01 11:29:54 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:54 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1" returned: 0 in 0.575s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:55 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1 Sep 01 11:29:55 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Flow 'volume_create_manager' (643d42d2-ea7b-4f63-947a-0a1291f07aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1c3248-5829-4d8c-a74c-2fb2b0cd33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1c3248-5829-4d8c-a74c-2fb2b0cd33ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-74334900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f29b07-b8c5-4a84-9a4f-76af6b5428e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2633d7588b1400897918bbf341a7020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:55Z,use_quota=True,user_id='bf9c5f2a5ffb4b8a8915f96c6a40d6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0765dc63-d5ad-46f6-8bcf-e5ee4ed8b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0765dc63-d5ad-46f6-8bcf-e5ee4ed8b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95854ad8-1985-45b1-ada3-94698f73629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95854ad8-1985-45b1-ada3-94698f73629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f29b07-b8c5-4a84-9a4f-76af6b5428e2', 'volume_name': 'volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e99d814-aeb5-457b-9e69-3fcf4678a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e99d814-aeb5-457b-9e69-3fcf4678a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2a6397-8e42-4d04-8e39-355c7756d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:55 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Volume c9f29b07-b8c5-4a84-9a4f-76af6b5428e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2', 'volume_size': 1} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-74334900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f29b07-b8c5-4a84-9a4f-76af6b5428e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2633d7588b1400897918bbf341a7020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:55Z,use_quota=True,user_id='bf9c5f2a5ffb4b8a8915f96c6a40d6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Creating volume c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:55 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:55 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 1073741824 Sep 01 11:29:55 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:55 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-46d2dd10-353f-4409-8f37-77dae02320f1" returned: 0 in 0.597s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-46d2dd10-353f-4409-8f37-77dae02320f1" released by "delete_volume" :: held 1.223s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Created reservations ['bfaf30f3-fdee-44a1-a139-677c87d331b4', '89cca7cd-714a-44ed-a39a-f2f850dc4675', 'b4852231-bec0-446e-9048-78681639a184', 'ad4e215c-d57f-4b22-a3f3-c7a16184a2fa'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:55 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:55 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:56 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Deleted volume successfully. Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ee5cdfd0-4f50-4f4d-9c3a-05cda8c78c43 tempest-VolumesCloneTest-564915104 None] Lock "cinder-46d2dd10-353f-4409-8f37-77dae02320f1-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:56 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 1073741824" returned: 0 in 0.704s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:56 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 Sep 01 11:29:56 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:56 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2" returned: 0 in 0.302s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2a6397-8e42-4d04-8e39-355c7756d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ef77dc-f47f-4d5f-8683-fa6ba771b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Volume volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 (c9f29b07-b8c5-4a84-9a4f-76af6b5428e2): created successfully Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ef77dc-f47f-4d5f-8683-fa6ba771b096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Flow 'volume_create_manager' (643d42d2-ea7b-4f63-947a-0a1291f07aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0c97b86c-b4f8-4e8a-9334-661e92c4a837 tempest-VolumesListAdminTestJSON-1931786820 None] Created volume successfully. Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Acquiring lock "cinder-eaa327cd-a387-42f6-8712-4efd5d998180-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Lock "cinder-eaa327cd-a387-42f6-8712-4efd5d998180-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Acquiring lock "cinder-quobyte-eaa327cd-a387-42f6-8712-4efd5d998180" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-eaa327cd-a387-42f6-8712-4efd5d998180" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8456ce-ec12-4b5a-bd0d-b8915b0313de]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:29:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:57 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:57 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:57 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.667s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:57 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180 Sep 01 11:29:57 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:57 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eaa327cd-a387-42f6-8712-4efd5d998180" returned: 0 in 0.357s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Lock "cinder-quobyte-eaa327cd-a387-42f6-8712-4efd5d998180" released by "delete_volume" :: held 1.119s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Created reservations ['c4e98015-6d8c-43ea-9a9a-4db3e885faa9', '9287280c-cb72-4f1d-b81c-058373859bf7', 'bfbc0da6-a6f0-4171-8aaa-41d765421dd4', '1c4aa0db-bb2c-4517-ba49-fa896ed226e1'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:58 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:29:58 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Flow 'volume_create_manager' (0c368b73-a14a-4dd1-bcd7-30ed8884c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952ac6b8-8c79-4f73-aaf9-066091b253e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952ac6b8-8c79-4f73-aaf9-066091b253e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2104562160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10192b90-b3a6-40f2-a4f9-be72bedfa0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2633d7588b1400897918bbf341a7020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:58Z,use_quota=True,user_id='bf9c5f2a5ffb4b8a8915f96c6a40d6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b31740-e8a0-43c5-87ca-7c7ed8d5e3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b31740-e8a0-43c5-87ca-7c7ed8d5e3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c294a428-4d6b-493d-8f7f-063814af96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c294a428-4d6b-493d-8f7f-063814af96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10192b90-b3a6-40f2-a4f9-be72bedfa0cb', 'volume_name': 'volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93254a8b-2b66-4cd9-a484-95225fa7c1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93254a8b-2b66-4cd9-a484-95225fa7c1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f400324-a7c5-4ea6-884d-a9206701162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:58 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Volume 10192b90-b3a6-40f2-a4f9-be72bedfa0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb', 'volume_size': 1} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2104562160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10192b90-b3a6-40f2-a4f9-be72bedfa0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2633d7588b1400897918bbf341a7020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:29:58Z,use_quota=True,user_id='bf9c5f2a5ffb4b8a8915f96c6a40d6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Creating volume 10192b90-b3a6-40f2-a4f9-be72bedfa0cb {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:29:58 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:58 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb 1073741824 Sep 01 11:29:58 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:58 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.374s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:29:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Deleted volume successfully. Sep 01 11:29:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3788c59-b107-41ff-bc66-2dea383f8b38 tempest-VolumesCloneTest-564915104 None] Lock "cinder-eaa327cd-a387-42f6-8712-4efd5d998180-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:29:59 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb 1073741824" returned: 0 in 0.552s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:29:59 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb Sep 01 11:29:59 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:29:59 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb" returned: 0 in 0.353s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f400324-a7c5-4ea6-884d-a9206701162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4858af2c-e150-47ae-a887-a83f7a5a8e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:29:59 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Volume volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb (10192b90-b3a6-40f2-a4f9-be72bedfa0cb): created successfully Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4858af2c-e150-47ae-a887-a83f7a5a8e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:29:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Flow 'volume_create_manager' (0c368b73-a14a-4dd1-bcd7-30ed8884c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:29:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f4f7878b-6c72-4e4a-b927-79a2675e564e tempest-VolumesListAdminTestJSON-1931786820 None] Created volume successfully. Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (6b38b1a6-a685-46ef-b40a-320df2ecfa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6287866-cb6e-4355-a8c1-870497243ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6287866-cb6e-4355-a8c1-870497243ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-25192369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e09490-27d1-4ce6-a52f-3490ebbec780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:01Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0d84f1-ffa7-4fc2-b617-36fd080c0d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0d84f1-ffa7-4fc2-b617-36fd080c0d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deef1bb8-b718-49f3-9129-e44a05a6f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deef1bb8-b718-49f3-9129-e44a05a6f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e09490-27d1-4ce6-a52f-3490ebbec780', 'volume_name': 'volume-f3e09490-27d1-4ce6-a52f-3490ebbec780', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d571ef75-6a70-4be1-ab87-fb9ad41dad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d571ef75-6a70-4be1-ab87-fb9ad41dad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dce140-a34b-456c-80f2-f13873f8aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:00 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Volume f3e09490-27d1-4ce6-a52f-3490ebbec780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e09490-27d1-4ce6-a52f-3490ebbec780', 'volume_size': 1} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-25192369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e09490-27d1-4ce6-a52f-3490ebbec780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:01Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Creating volume f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:00 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:30:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:00 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 1073741824 Sep 01 11:30:00 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Flow 'volume_create_manager' (cd785a97-03d4-48ec-aa48-7bd2627c656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320e5d21-54ce-4b3e-8362-e99f5741263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320e5d21-54ce-4b3e-8362-e99f5741263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d119b759-8a1c-49d1-a3b6-90c96eaebe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff183d8c07e940e38fd655121ea48d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:01Z,use_quota=True,user_id='8930d0d276a34b53b20abf6110b56a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e4905-ba3f-49b2-b12d-47393d4c330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e4905-ba3f-49b2-b12d-47393d4c330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335010f0-28e7-4044-982c-64f69a44b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335010f0-28e7-4044-982c-64f69a44b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd119b759-8a1c-49d1-a3b6-90c96eaebe2b', 'volume_name': 'volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24d03c4-58d7-4356-9dba-5b139580d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24d03c4-58d7-4356-9dba-5b139580d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03130221-17b8-45f7-903e-9fa4ccee4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Volume d119b759-8a1c-49d1-a3b6-90c96eaebe2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b', 'volume_size': 1} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:01 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 1073741824" returned: 0 in 0.628s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:01 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 Sep 01 11:30:01 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:01 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780" returned: 0 in 0.296s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d119b759-8a1c-49d1-a3b6-90c96eaebe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff183d8c07e940e38fd655121ea48d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:01Z,use_quota=True,user_id='8930d0d276a34b53b20abf6110b56a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Creating volume d119b759-8a1c-49d1-a3b6-90c96eaebe2b {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:01 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dce140-a34b-456c-80f2-f13873f8aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e09490-27d1-4ce6-a52f-3490ebbec780', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b216313c-019b-46a2-aad2-dbd5408428ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:01 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b 1073741824 Sep 01 11:30:01 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Volume volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 (f3e09490-27d1-4ce6-a52f-3490ebbec780): created successfully Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b216313c-019b-46a2-aad2-dbd5408428ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (6b38b1a6-a685-46ef-b40a-320df2ecfa1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9f4ad62c-f500-4a2f-9f73-49a074197d1a tempest-VolumesSnapshotTestJSON-1325444229 None] Created volume successfully. Sep 01 11:30:02 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b 1073741824" returned: 0 in 0.515s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:02 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b Sep 01 11:30:02 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:02 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03130221-17b8-45f7-903e-9fa4ccee4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303e4753-3260-4277-b991-0e4d119a1476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:02 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Volume volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b (d119b759-8a1c-49d1-a3b6-90c96eaebe2b): created successfully Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303e4753-3260-4277-b991-0e4d119a1476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Flow 'volume_create_manager' (cd785a97-03d4-48ec-aa48-7bd2627c656c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-aa91dcc9-517d-4fba-a7e0-5b4ae224ca76 tempest-VolumesListAdminTestJSON-92703084 None] Created volume successfully. Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Creating offline snapshot 1d21a84e-3d33-4690-ba7f-b6c73043edcc of volume f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8b6c8f-f9ac-4849-b07a-9bdd93873ab8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:03 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 Sep 01 11:30:03 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Acquiring lock "cinder-d119b759-8a1c-49d1-a3b6-90c96eaebe2b-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Lock "cinder-d119b759-8a1c-49d1-a3b6-90c96eaebe2b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:03 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:03 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc 1G Sep 01 11:30:03 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Acquiring lock "cinder-quobyte-d119b759-8a1c-49d1-a3b6-90c96eaebe2b" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Lock "cinder-quobyte-d119b759-8a1c-49d1-a3b6-90c96eaebe2b" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "cinder-10192b90-b3a6-40f2-a4f9-be72bedfa0cb-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[62664db6-743c-4a86-9429-8249963aeb8a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-10192b90-b3a6-40f2-a4f9-be72bedfa0cb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "cinder-quobyte-10192b90-b3a6-40f2-a4f9-be72bedfa0cb" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-quobyte-10192b90-b3a6-40f2-a4f9-be72bedfa0cb" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f685366-8010-4a5e-9254-a121b482f077]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:03 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b Sep 01 11:30:03 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb Sep 01 11:30:04 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc 1G" returned: 0 in 0.541s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:04 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc Sep 01 11:30:04 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b" returned: 0 in 0.473s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:04 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b Sep 01 11:30:04 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb" returned: 0 in 0.461s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:04 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb Sep 01 11:30:04 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d119b759-8a1c-49d1-a3b6-90c96eaebe2b" returned: 0 in 0.305s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc is being set with open permissions: ugo+rw Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:04 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc Sep 01 11:30:04 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Lock "cinder-quobyte-d119b759-8a1c-49d1-a3b6-90c96eaebe2b" released by "delete_volume" :: held 0.901s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:04 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:04 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:04 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-10192b90-b3a6-40f2-a4f9-be72bedfa0cb" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-quobyte-10192b90-b3a6-40f2-a4f9-be72bedfa0cb" released by "delete_volume" :: held 0.844s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Created reservations ['5fe33ed8-6f9a-4828-bcf9-86aca79e6f26', 'c15819d2-1291-47a1-9ba1-b334c4e718f6', '15444a26-b673-4e26-960c-a09fdffba897', '77e02cd5-1c5e-4cc8-8555-fe0cb28286e5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Created reservations ['0e78d4a4-79b8-473f-9393-28b4891844ff', 'e0b3534f-e861-4cc9-afcf-5ecb48b87d8e', 'b88be03a-8bac-41d3-abcc-86736e6d03df', 'cb9fc345-0231-4455-ab22-4c652280d503'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:04 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc" returned: 0 in 0.423s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:04 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:05 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:05 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:05 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:05 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.502s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:30:05 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info Sep 01 11:30:05 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "cinder-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:05 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.401s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "cinder-quobyte-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Deleted volume successfully. Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-quobyte-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2" acquired by "delete_volume" :: waited 0.038s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebc9d193-0611-46a9-b304-3dce0eca809f tempest-VolumesListAdminTestJSON-92703084 None] Lock "cinder-d119b759-8a1c-49d1-a3b6-90c96eaebe2b-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e87953-feae-49db-bcf7-21a16094ac2d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:05 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.449s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Deleted volume successfully. Sep 01 11:30:05 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info" returned: 0 in 0.437s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:05 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info is being set with open permissions: ugo+rw Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e1b1c9b-ea2c-414b-a450-e6817276ebe7 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-10192b90-b3a6-40f2-a4f9-be72bedfa0cb-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:05 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info Sep 01 11:30:05 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:05 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 Sep 01 11:30:05 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:05 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.info" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:05 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2" returned: 0 in 0.472s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:05 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2 Sep 01 11:30:05 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-43030aca-9448-4a43-867c-c1304e8cd7d8 tempest-VolumesSnapshotTestJSON-1325444229 None] Create snapshot completed successfully Sep 01 11:30:06 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-quobyte-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2" released by "delete_volume" :: held 0.808s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Created reservations ['8918c136-272a-48e8-9530-bdd0c9b4fdfc', 'fdc58a96-88c7-4dc7-9f00-1672482f5f7a', '50eab6b2-08eb-48a5-a4ed-065bdbffb356', 'c0619d12-29db-46d8-9466-ce8a5c61b646'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:06 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:06 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-1d21a84e-3d33-4690-ba7f-b6c73043edcc-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "cinder-7406686d-f99b-4f19-95fd-8fef231e1814-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-7406686d-f99b-4f19-95fd-8fef231e1814-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-1d21a84e-3d33-4690-ba7f-b6c73043edcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "cinder-quobyte-7406686d-f99b-4f19-95fd-8fef231e1814" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-f3e09490-27d1-4ce6-a52f-3490ebbec780" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-quobyte-7406686d-f99b-4f19-95fd-8fef231e1814" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:06 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-f3e09490-27d1-4ce6-a52f-3490ebbec780" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-1d21a84e-3d33-4690-ba7f-b6c73043edcc" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.472s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[404e4de5-be40-44b2-a168-b853cb506892]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-1d21a84e-3d33-4690-ba7f-b6c73043edcc" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Deleting offline snapshot 1d21a84e-3d33-4690-ba7f-b6c73043edcc of volume f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] snapshot_file for this snap is: volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:30:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Deleted volume successfully. Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701ec22-302f-4c54-9633-69d1217e133b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b66152ab-95d3-47a8-ab7f-7c8c1c938017 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-c9f29b07-b8c5-4a84-9a4f-76af6b5428e2-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:06 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 Sep 01 11:30:06 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:07 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc Sep 01 11:30:07 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:07 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814" returned: 0 in 0.444s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:07 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814 Sep 01 11:30:07 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:07 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc" returned: 0 in 0.537s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e09490-27d1-4ce6-a52f-3490ebbec780(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edcced2-e09f-40f2-a5dc-f8b5e54fa06a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:07 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7406686d-f99b-4f19-95fd-8fef231e1814" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-quobyte-7406686d-f99b-4f19-95fd-8fef231e1814" released by "delete_volume" :: held 0.779s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:07 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 Sep 01 11:30:07 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Created reservations ['9155c181-dfbc-4c36-a7fa-7446e631d705', '464c69e6-96f6-4980-9bea-6a2e1620f344', 'f3651a66-9b08-439c-a879-cd34ac794f5d', 'be4278a4-e88f-4ac8-ba6f-fd04cb0523b5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:07 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:07 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:08 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780" returned: 0 in 0.557s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:08 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc Sep 01 11:30:08 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:08 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.538s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Deleted volume successfully. Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-01b3db41-229c-46bc-b099-b4d8c79a6b67 tempest-VolumesListAdminTestJSON-1931786820 None] Lock "cinder-7406686d-f99b-4f19-95fd-8fef231e1814-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:08 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc" returned: 0 in 0.489s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:08 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc Sep 01 11:30:08 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:08 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780.1d21a84e-3d33-4690-ba7f-b6c73043edcc" returned: 0 in 0.294s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-1d21a84e-3d33-4690-ba7f-b6c73043edcc" released by "_delete_snapshot" :: held 2.016s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-f3e09490-27d1-4ce6-a52f-3490ebbec780" released by "delete_snapshot" :: held 2.066s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:08 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['0550fb06-1479-47fb-9820-3d035387fc3d', '742b8192-0c4a-4b09-a0c7-8d744b945f3d', '1d14b44d-2618-41d9-af93-53cd18efa2b9', '3af121a6-09a5-4451-beb1-2d4d1d5d52f4'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Delete snapshot completed successfully. Sep 01 11:30:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9763fe0a-fcaf-415b-92af-0de886c6fffa tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-1d21a84e-3d33-4690-ba7f-b6c73043edcc-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=156,cinder:SELECT=107,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=115,cinder:UPDATE=136,cinder:DELETE=14,cinder:INSERT=36 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (f08d7d1a-7ab2-463a-919b-d2dc78e3a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28358120-a21b-4a21-8b60-664cac43b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28358120-a21b-4a21-8b60-664cac43b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497584247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:11Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259c80c7-9057-44f5-ae84-ecf9de010423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259c80c7-9057-44f5-ae84-ecf9de010423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70301534-20d2-48ca-a2c6-2a1ecfde4c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70301534-20d2-48ca-a2c6-2a1ecfde4c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca', 'volume_name': 'volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e66ac2-e806-4426-8cd5-21560e023697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e66ac2-e806-4426-8cd5-21560e023697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5db5c62-2176-4abc-a11e-557beec8696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:10 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Volume 6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca', 'volume_size': 1} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497584247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:11Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Creating volume 6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:10 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:30:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:10 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca 1073741824 Sep 01 11:30:10 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:11 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca 1073741824" returned: 0 in 0.696s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:11 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:11 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:12 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.510s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5db5c62-2176-4abc-a11e-557beec8696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b3d555-405b-4852-9085-ddfb195bd992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:12 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Volume volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca (6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca): created successfully Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b3d555-405b-4852-9085-ddfb195bd992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (f08d7d1a-7ab2-463a-919b-d2dc78e3a048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5e8ebc82-b877-4357-844c-93c8577464cb tempest-VolumesSnapshotTestJSON-1325444229 None] Created volume successfully. Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Creating offline snapshot b3b45f2c-435b-471a-b3fc-0e95f0393c0e of volume 6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de4f135-5094-436c-ab61-3cf750f2428c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:13 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:13 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:13 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.533s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:13 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e 1G Sep 01 11:30:13 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:14 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e 1G" returned: 0 in 0.663s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:14 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e Sep 01 11:30:14 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:14 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e" returned: 0 in 0.439s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:14 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e is being set with open permissions: ugo+rw Sep 01 11:30:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:14 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e Sep 01 11:30:14 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:15 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:15 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info Sep 01 11:30:15 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:15 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info" returned: 0 in 0.319s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:15 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info is being set with open permissions: ugo+rw Sep 01 11:30:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:15 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info Sep 01 11:30:15 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:15 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.info" returned: 0 in 0.328s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-45121517-b25c-45b3-b83a-991dce9fac9b tempest-VolumesSnapshotTestJSON-1325444229 None] Create snapshot completed successfully Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (1a078380-7ecb-4c2a-ac61-d1115e428b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa296a3-b562-4638-9cdd-93487e22b26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa296a3-b562-4638-9cdd-93487e22b26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-412146812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b3b45f2c-435b-471a-b3fc-0e95f0393c0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:17Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b6bb7-5cca-4184-88e4-4d91cabcf2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b6bb7-5cca-4184-88e4-4d91cabcf2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f535da75-27a0-4e1f-b095-637573586641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f535da75-27a0-4e1f-b095-637573586641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd', 'volume_name': 'volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd', 'volume_size': 2, 'snapshot_id': 'b3b45f2c-435b-471a-b3fc-0e95f0393c0e'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5351921a-3633-425a-8c41-45d62951c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5351921a-3633-425a-8c41-45d62951c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd80bd5-2ae2-4c9a-9176-9f168474d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Volume b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd', 'volume_size': 2, 'snapshot_id': 'b3b45f2c-435b-471a-b3fc-0e95f0393c0e'} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-b3b45f2c-435b-471a-b3fc-0e95f0393c0e-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b3b45f2c-435b-471a-b3fc-0e95f0393c0e-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Creating volume b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd from snapshot b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] snapshot: b3b45f2c-435b-471a-b3fc-0e95f0393c0e, volume: b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a42af-664c-4251-ae0d-06b8834ed29b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:17 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e Sep 01 11:30:17 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:17 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e" returned: 0 in 0.423s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf68868-ba01-4d09-8ad6-1d94ee34ce4a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:17 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:17 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:17 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.474s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:30:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:18 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd Sep 01 11:30:18 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Flow 'volume_create_manager' (ebf6ddcf-e9b2-442b-850b-3d4806397a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1eefc1-95bd-43ee-883d-2002493e5261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1eefc1-95bd-43ee-883d-2002493e5261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-344628700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2a6406-cb40-4a85-9967-b3b224c526d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598e57d663a4572987fed07d842bccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:20Z,use_quota=True,user_id='9595b30f9cef4333b70c974fce809c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e94c2e-2d28-4d77-91ed-593bc196a542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e94c2e-2d28-4d77-91ed-593bc196a542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b6aedf-87fe-4d09-9f39-b0b163894fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:30:20 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-051bcf25-293a-4929-9796-49554505c664 req-d508bce7-87a4-421e-abc8-38f4c92149b8 tempest-AttachVolumeNegativeTest-911563986 None] Terminate volume connection completed successfully. Sep 01 11:30:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-051bcf25-293a-4929-9796-49554505c664 req-d508bce7-87a4-421e-abc8-38f4c92149b8 tempest-AttachVolumeNegativeTest-911563986 None] Deleting attachment ba3790d8-c176-4550-adc6-9e4ac8726b27. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:30:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b6aedf-87fe-4d09-9f39-b0b163894fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee2a6406-cb40-4a85-9967-b3b224c526d4', 'volume_name': 'volume-ee2a6406-cb40-4a85-9967-b3b224c526d4', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb84f7-1ab2-4cbb-86b5-0ee3929f035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb84f7-1ab2-4cbb-86b5-0ee3929f035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d223f4f-10cb-4e3e-9b98-8334310244f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Volume ee2a6406-cb40-4a85-9967-b3b224c526d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee2a6406-cb40-4a85-9967-b3b224c526d4', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 11:30:21 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Trying to clone ee2a6406-cb40-4a85-9967-b3b224c526d4 from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:30:22 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD, size 20.69 MB, duration 1.02 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:30:22 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Image download 20.69 MB at 20.31 MB/s Sep 01 11:30:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1a1127-25b3-4762-b6a0-002aa559104b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:22 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD Sep 01 11:30:22 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:23 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD" returned: 0 in 1.129s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:23 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b is fetched for user 9595b30f9cef4333b70c974fce809c04. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:30:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[949fbbdb-92e0-41a5-bc7e-f377e650e063]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:24 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD Sep 01 11:30:24 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:24 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" returned: 0 in 6.466s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f695ff-4a4f-42a3-b726-baf48a4acf37]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:24 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:24 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:24 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:25 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.604s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:30:25 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Converted 1024.00 MB image at 158.29 MB/s Sep 01 11:30:25 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd is being set with open permissions: ugo+rw Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:25 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd Sep 01 11:30:25 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:25 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" released by "_copy_volume_from_snapshot" :: held 8.352s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b3b45f2c-435b-471a-b3fc-0e95f0393c0e-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" released by "_create_volume_from_snapshot" :: held 8.390s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.413s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-344628700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2a6406-cb40-4a85-9967-b3b224c526d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598e57d663a4572987fed07d842bccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:20Z,use_quota=True,user_id='9595b30f9cef4333b70c974fce809c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Creating volume ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:25 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:25 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 1073741824 Sep 01 11:30:25 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd80bd5-2ae2-4c9a-9176-9f168474d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd', 'volume_size': 2, 'snapshot_id': 'b3b45f2c-435b-471a-b3fc-0e95f0393c0e'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3aba89-437d-417e-b3ef-e2c486e49d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:25 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Volume volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd (b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd): created successfully Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3aba89-437d-417e-b3ef-e2c486e49d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (1a078380-7ecb-4c2a-ac61-d1115e428b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f4f86ab6-f4c9-4a6b-9b13-18d32a7f50f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Created volume successfully. Sep 01 11:30:26 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 1073741824" returned: 0 in 0.631s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:26 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:26 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5fd329-6169-407f-9bda-7b32a8404e79]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:26 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd Sep 01 11:30:26 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:26 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 0 in 0.388s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Attempting download of 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume ee2a6406-cb40-4a85-9967-b3b224c526d4. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[626bf674-2946-45b2-9120-aa77adac845e]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:26 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" returned: 0 in 0.473s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:26 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb Sep 01 11:30:26 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:26 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd Sep 01 11:30:26 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:27 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb" returned: 0 in 0.477s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:27 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" returned: 0 in 0.348s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd" released by "delete_volume" :: held 0.887s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:27 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb Sep 01 11:30:27 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['1926ebdd-bd84-43b8-9c93-e5d4fe3bef87', '524ab550-1005-44b9-89a8-958011a52abb', '61da3ded-184b-402c-8179-96946f9a4d7a', 'e35e7f06-c2c3-479c-9fd8-8dbacb7f3083'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:27 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:27 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:27 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb" returned: 1 in 0.495s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_tun430wb' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad81f98-5c0c-4f24-9802-e4489520237e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:27 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.291s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:27 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD Sep 01 11:30:27 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleted volume successfully. Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c6396eeb-dbea-4712-9932-be63f4c21674 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-b2841c44-7b5d-4b7d-bdb1-5f54d3ea91dd-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:27 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b was qcow2, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:30:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:27 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:27 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-b3b45f2c-435b-471a-b3fc-0e95f0393c0e-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-b3b45f2c-435b-471a-b3fc-0e95f0393c0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-b3b45f2c-435b-471a-b3fc-0e95f0393c0e" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b3b45f2c-435b-471a-b3fc-0e95f0393c0e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleting offline snapshot b3b45f2c-435b-471a-b3fc-0e95f0393c0e of volume 6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] snapshot_file for this snap is: volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e6515f-f326-45a2-a0be-a33557bf8ee7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:28 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e Sep 01 11:30:28 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:29 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e" returned: 0 in 0.609s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f7830-b527-4a1a-b36a-396287261e67]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:29 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:29 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:29 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.448s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:29 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e Sep 01 11:30:29 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:29 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 0 in 2.068s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_0nullr9idevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:30:30 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Converted 112.00 MB image at 54.11 MB/s Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:30 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 1G Sep 01 11:30:30 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:30 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e" returned: 0 in 0.485s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:30 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e Sep 01 11:30:30 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:30 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 1G" returned: 0 in 0.506s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[861063ca-b167-4ed7-a666-69f9adfd35c0]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:30 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca.b3b45f2c-435b-471a-b3fc-0e95f0393c0e" returned: 0 in 0.443s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-b3b45f2c-435b-471a-b3fc-0e95f0393c0e" released by "_delete_snapshot" :: held 2.150s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" released by "delete_snapshot" :: held 2.186s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:30 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:30 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['b3277150-507b-4406-bb5d-8b242a70667a', 'acde4f1e-4972-481d-9e40-679b3347a370', 'ee4583c6-cafe-4bc1-82c5-4a8c5fd525fe', '9137efc6-f64d-4094-a271-85c0c9cb93dd'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Delete snapshot completed successfully. Sep 01 11:30:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24b14022-c94c-4296-8900-eb32bded8c42 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-b3b45f2c-435b-471a-b3fc-0e95f0393c0e-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:31 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 0 in 0.489s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:31 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:31 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:31 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 1 in 0.385s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Downloaded image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume ee2a6406-cb40-4a85-9967-b3b224c526d4 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b for user 9595b30f9cef4333b70c974fce809c04 is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Marking volume ee2a6406-cb40-4a85-9967-b3b224c526d4 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Copying metadata from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b to ee2a6406-cb40-4a85-9967-b3b224c526d4. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Creating volume glance metadata for volume ee2a6406-cb40-4a85-9967-b3b224c526d4 backed by image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d223f4f-10cb-4e3e-9b98-8334310244f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2a6406-cb40-4a85-9967-b3b224c526d4', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b4fd3e-5322-42e0-aa1d-dc2950e146dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:31 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Volume volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 (ee2a6406-cb40-4a85-9967-b3b224c526d4): created successfully Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b4fd3e-5322-42e0-aa1d-dc2950e146dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Flow 'volume_create_manager' (ebf6ddcf-e9b2-442b-850b-3d4806397a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bc3a868c-21d3-4c38-84f1-aae90ade75eb tempest-VolumesImageMetadata-186652356 None] Created volume successfully. Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[463532d4-c233-42c8-9c81-b384aca4c73f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:32 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:32 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Flow 'volume_create_manager' (f27c4034-87d2-437a-8c64-16631aa9015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33bd58f-7347-4dfe-9620-6ebf785b0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33bd58f-7347-4dfe-9620-6ebf785b0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-60371232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb41482-06da-4b86-bd20-36d3b3141469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79efc07b2b8447c4b4671a31c1366f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:32Z,use_quota=True,user_id='5739a70e9a16494a9376181785a5e959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0656bd-4e70-44a3-9d8e-ebed347f2cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0656bd-4e70-44a3-9d8e-ebed347f2cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391d6f96-4c80-4769-b084-5e64d6e1a6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391d6f96-4c80-4769-b084-5e64d6e1a6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb41482-06da-4b86-bd20-36d3b3141469', 'volume_name': 'volume-3bb41482-06da-4b86-bd20-36d3b3141469', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7581c736-4a34-4b53-8861-79d08e49aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7581c736-4a34-4b53-8861-79d08e49aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887a599d-b18c-49af-8fcb-765fb40b8d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Volume 3bb41482-06da-4b86-bd20-36d3b3141469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb41482-06da-4b86-bd20-36d3b3141469', 'volume_size': 1} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-60371232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb41482-06da-4b86-bd20-36d3b3141469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79efc07b2b8447c4b4671a31c1366f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:32Z,use_quota=True,user_id='5739a70e9a16494a9376181785a5e959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Creating volume 3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:32 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:32 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 1073741824 Sep 01 11:30:32 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:32 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.395s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:32 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca Sep 01 11:30:32 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:32 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca" released by "delete_volume" :: held 0.826s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:32 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 1073741824" returned: 0 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['ffa95e36-19a0-4c17-a3c2-87f2a23c904e', '83efa561-7bf3-4043-9f3f-28da31ca67bf', '3dd87c1d-23a1-4a88-a973-fe5636b28294', '1535b812-a426-4c58-9855-1c538ca73541'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:32 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 Sep 01 11:30:32 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Acquiring lock "cinder-ee2a6406-cb40-4a85-9967-b3b224c526d4-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Lock "cinder-ee2a6406-cb40-4a85-9967-b3b224c526d4-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:32 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:32 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Acquiring lock "cinder-quobyte-ee2a6406-cb40-4a85-9967-b3b224c526d4" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Lock "cinder-quobyte-ee2a6406-cb40-4a85-9967-b3b224c526d4" acquired by "delete_volume" :: waited 0.085s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace9f1c-f0ba-4dfb-a002-10657b596560]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:33 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469" returned: 0 in 0.472s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887a599d-b18c-49af-8fcb-765fb40b8d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb41482-06da-4b86-bd20-36d3b3141469', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:33 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a3778f-44ed-42b8-b35b-6847ae91e464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.421s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleted volume successfully. Sep 01 11:30:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Volume volume-3bb41482-06da-4b86-bd20-36d3b3141469 (3bb41482-06da-4b86-bd20-36d3b3141469): created successfully Sep 01 11:30:33 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:33 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a3778f-44ed-42b8-b35b-6847ae91e464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Flow 'volume_create_manager' (f27c4034-87d2-437a-8c64-16631aa9015e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-52ecac2f-de50-454a-ad2e-bdfcbcd2e157 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-6b1c2ebc-63e8-4757-85dd-5d0a7a28c1ca-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2e3125d6-ebbf-48d1-b45b-3217727fbb26 tempest-TestImageHashVerification-947087345 None] Created volume successfully. Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 0 in 0.480s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:33 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:33 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:33 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (5ab1fe13-8c6f-4095-af7d-01efaf58a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c7f01-9de1-4dd6-abf7-13909bfba322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c7f01-9de1-4dd6-abf7-13909bfba322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-517204782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37851d8f-9146-4664-9faa-1b05ffb5427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:34Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25bb751-26b8-4a5e-9257-c196e00a025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25bb751-26b8-4a5e-9257-c196e00a025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34076352-1b72-4038-8985-6f41966272ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34076352-1b72-4038-8985-6f41966272ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37851d8f-9146-4664-9faa-1b05ffb5427d', 'volume_name': 'volume-37851d8f-9146-4664-9faa-1b05ffb5427d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64cde58-ed38-4a1a-b2a6-0f14122c8fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64cde58-ed38-4a1a-b2a6-0f14122c8fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b7ca1a-57a5-4ce1-bedc-2c8f1b0bd7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Volume 37851d8f-9146-4664-9faa-1b05ffb5427d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37851d8f-9146-4664-9faa-1b05ffb5427d', 'volume_size': 1} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-517204782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37851d8f-9146-4664-9faa-1b05ffb5427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:34Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Creating volume 37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:30:33 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:30:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:34 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d 1073741824 Sep 01 11:30:34 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:34 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 1 in 0.510s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:34 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4 Sep 01 11:30:34 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:34 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ee2a6406-cb40-4a85-9967-b3b224c526d4" returned: 0 in 0.355s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Lock "cinder-quobyte-ee2a6406-cb40-4a85-9967-b3b224c526d4" released by "delete_volume" :: held 1.488s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:34 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d 1073741824" returned: 0 in 0.656s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Created reservations ['990da98a-d6fd-4621-9b49-a8e521229e95', 'c6113e61-35ff-46ef-ab7f-f3b857270c7c', 'c9a76350-a139-4c16-8cee-e1e290ad6062', 'acdd41da-2d58-48f8-ad2a-14d6cfca970f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:34 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:30:34 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:34 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:30:34 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:35 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.389s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b7ca1a-57a5-4ce1-bedc-2c8f1b0bd7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37851d8f-9146-4664-9faa-1b05ffb5427d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb0e6b7-7033-4e0b-9159-8162ad68a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Volume volume-37851d8f-9146-4664-9faa-1b05ffb5427d (37851d8f-9146-4664-9faa-1b05ffb5427d): created successfully Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb0e6b7-7033-4e0b-9159-8162ad68a68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (5ab1fe13-8c6f-4095-af7d-01efaf58a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:35 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.369s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:30:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Deleted volume successfully. Sep 01 11:30:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9f3cba83-fc31-4ebb-9c53-44bf722bebaf tempest-VolumesSnapshotTestJSON-1325444229 None] Created volume successfully. Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1bbd0986-d929-4b20-8f6c-acd8177956a5 tempest-VolumesImageMetadata-186652356 None] Lock "cinder-ee2a6406-cb40-4a85-9967-b3b224c526d4-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[084affd8-8ff1-45eb-bd25-a87cb1e168fd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:35 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 Sep 01 11:30:35 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:36 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469" returned: 0 in 0.547s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:36 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f522e0-fbc8-4266-954b-fb97621d4977]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:36 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 Sep 01 11:30:36 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:36 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469" returned: 0 in 0.470s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 /opt/stack/data/cinder/conversion/3bb41482-06da-4b86-bd20-36d3b3141469.temp_image.39ba2341-db37-4584-b41a-188496fb0aa46lxqt2of.img {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:36 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 /opt/stack/data/cinder/conversion/3bb41482-06da-4b86-bd20-36d3b3141469.temp_image.39ba2341-db37-4584-b41a-188496fb0aa46lxqt2of.img Sep 01 11:30:36 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:44 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 /opt/stack/data/cinder/conversion/3bb41482-06da-4b86-bd20-36d3b3141469.temp_image.39ba2341-db37-4584-b41a-188496fb0aa46lxqt2of.img" returned: 0 in 7.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab12fe1d-e7e1-4629-a9cb-abb8da2f5482]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:30:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:30:44 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 Sep 01 11:30:44 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:30:44 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 01 11:30:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469" returned: 0 in 0.717s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:30:44 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/conversion/3bb41482-06da-4b86-bd20-36d3b3141469.temp_image.39ba2341-db37-4584-b41a-188496fb0aa46lxqt2of.img {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:30:44 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Converted 1024.00 MB image at 141.01 MB/s Sep 01 11:30:44 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] 39ba2341-db37-4584-b41a-188496fb0aa4 was raw, no need to convert to raw {{(pid=87144) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Flow 'volume_create_manager' (b25524e5-3601-4e69-9b04-4f0d9543203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7511d3d2-2f33-46ec-bae4-6de206e09198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7511d3d2-2f33-46ec-bae4-6de206e09198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1769431698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec98a99-be34-4d04-ac19-b1bf79391273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c797d560f7c4ae9935bcaba0979aace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:45Z,use_quota=True,user_id='d0ae328f32884135ad488eb9f2fa318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a36bc9-a2f1-431b-ae9a-10e327beceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a36bc9-a2f1-431b-ae9a-10e327beceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f58c8a-6504-4e50-8d80-196d15000646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f58c8a-6504-4e50-8d80-196d15000646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec98a99-be34-4d04-ac19-b1bf79391273', 'volume_name': 'volume-1ec98a99-be34-4d04-ac19-b1bf79391273', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1b169e-dcf2-48cc-9628-f62a17a82eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1b169e-dcf2-48cc-9628-f62a17a82eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db21ca3-4add-4b3d-8c6d-a0ab916856c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:30:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Volume 1ec98a99-be34-4d04-ac19-b1bf79391273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec98a99-be34-4d04-ac19-b1bf79391273', 'volume_size': 1} Sep 01 11:30:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:30:55 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=40,cinder:UPDATE=43,cinder:DELETE=4,cinder:INSERT=21 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:30:55 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=52,cinder:SELECT=52,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.633s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Uploaded volume to glance image-id: 39ba2341-db37-4584-b41a-188496fb0aa4. {{(pid=87144) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 28.055s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Creating offline snapshot ffc07109-99f4-4a93-97ff-374ee73de3fd of volume 37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:31:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6d8a8e39-1a5b-4dd3-a990-1c53ec02d597 tempest-TestImageHashVerification-947087345 None] Copy volume to image completed successfully. Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3fcffa-8cd9-42aa-99d2-91bc9d71601f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:04 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:31:04 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:04 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:04 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:04 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:04 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd 1G Sep 01 11:31:04 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:04 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.255s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:31:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:31:05 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd 1G" returned: 0 in 0.407s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37851d8f-9146-4664-9faa-1b05ffb5427d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:05 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37851d8f-9146-4664-9faa-1b05ffb5427d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd Sep 01 11:31:05 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Flow 'volume_create_manager' (f8916c73-d098-4f73-99c5-db8c5e08f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:05 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1018ea41-ba8c-4eab-8dd3-e5cc8e27f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37851d8f-9146-4664-9faa-1b05ffb5427d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd" returned: 0 in 0.328s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:05 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd is being set with open permissions: ugo+rw Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:05 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1018ea41-ba8c-4eab-8dd3-e5cc8e27f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1581791300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ea732a-aaba-4ac3-90f7-7a0c02893035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401cfcd5f5654e808cb063f645dc6369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:05Z,use_quota=True,user_id='a64eba536af348a1b570dc3149e11c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:05 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725c40fb-a3b5-451c-be85-11f630da5007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725c40fb-a3b5-451c-be85-11f630da5007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd702a77-5c8e-4af6-b3e1-e7af917f4b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd702a77-5c8e-4af6-b3e1-e7af917f4b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ea732a-aaba-4ac3-90f7-7a0c02893035', 'volume_name': 'volume-25ea732a-aaba-4ac3-90f7-7a0c02893035', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804cb42b-e7b9-4ecc-9755-cecd5cb5d63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804cb42b-e7b9-4ecc-9755-cecd5cb5d63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e8771d-b08d-434d-9cf9-65adc7575f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:05 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Volume 25ea732a-aaba-4ac3-90f7-7a0c02893035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ea732a-aaba-4ac3-90f7-7a0c02893035', 'volume_size': 1} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:05 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd" returned: 0 in 0.241s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:05 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info Sep 01 11:31:05 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Acquiring lock "cinder-3bb41482-06da-4b86-bd20-36d3b3141469-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Lock "cinder-3bb41482-06da-4b86-bd20-36d3b3141469-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Acquiring lock "cinder-quobyte-3bb41482-06da-4b86-bd20-36d3b3141469" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Lock "cinder-quobyte-3bb41482-06da-4b86-bd20-36d3b3141469" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb6b91-af79-4fec-bffd-fbd8aa3803b4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:06 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:06 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info is being set with open permissions: ugo+rw Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:06 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info Sep 01 11:31:06 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:06 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 Sep 01 11:31:06 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:06 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.info" returned: 0 in 0.254s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.996s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1769431698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec98a99-be34-4d04-ac19-b1bf79391273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c797d560f7c4ae9935bcaba0979aace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:30:45Z,use_quota=True,user_id='d0ae328f32884135ad488eb9f2fa318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Creating volume 1ec98a99-be34-4d04-ac19-b1bf79391273 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:06 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:06 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 1073741824 Sep 01 11:31:06 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a20ccb2e-a064-4277-b799-0d224c5d57f1 tempest-VolumesSnapshotTestJSON-1325444229 None] Create snapshot completed successfully Sep 01 11:31:06 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469" returned: 0 in 0.402s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:06 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469 Sep 01 11:31:06 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:06 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3bb41482-06da-4b86-bd20-36d3b3141469" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Lock "cinder-quobyte-3bb41482-06da-4b86-bd20-36d3b3141469" released by "delete_volume" :: held 0.715s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:06 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 1073741824" returned: 0 in 0.430s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Created reservations ['08c79480-89f2-4571-ba92-e2159d46e01b', '158eda68-db05-40ca-9270-0f42a62fd53f', 'ea0a84c7-3d33-4e68-9452-1f848024a10c', 'e2c05828-149a-4ee5-be94-a9d114305122'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:06 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 Sep 01 11:31:06 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:06 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:06 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:07 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273" returned: 0 in 0.299s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1581791300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ea732a-aaba-4ac3-90f7-7a0c02893035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401cfcd5f5654e808cb063f645dc6369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:05Z,use_quota=True,user_id='a64eba536af348a1b570dc3149e11c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Creating volume 25ea732a-aaba-4ac3-90f7-7a0c02893035 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:07 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:07 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db21ca3-4add-4b3d-8c6d-a0ab916856c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec98a99-be34-4d04-ac19-b1bf79391273', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:07 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 1073741824 Sep 01 11:31:07 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395a8f5f-166d-4b5e-8b13-6e88abdaa988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.321s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Deleted volume successfully. Sep 01 11:31:07 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Volume volume-1ec98a99-be34-4d04-ac19-b1bf79391273 (1ec98a99-be34-4d04-ac19-b1bf79391273): created successfully Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395a8f5f-166d-4b5e-8b13-6e88abdaa988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Flow 'volume_create_manager' (b25524e5-3601-4e69-9b04-4f0d9543203f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-791f6ce2-8dcc-4956-b9ff-6b8c3ca5ce73 tempest-AbsoluteLimitsTests-1194639644 None] Created volume successfully. Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1064dccc-9213-4040-8aff-29e4602da0b2 tempest-TestImageHashVerification-947087345 None] Lock "cinder-3bb41482-06da-4b86-bd20-36d3b3141469-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (045e4c65-5ef5-4b66-a2d8-9592076519fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74714539-4017-4d0c-b6de-6ca065839359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74714539-4017-4d0c-b6de-6ca065839359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916325525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fa96dd-4083-481a-bdcf-2ca48db653eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2948579bfe2341e9b491f309eb104319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffc07109-99f4-4a93-97ff-374ee73de3fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:08Z,use_quota=True,user_id='e1967543c9de4536ad71f685257318bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7656dcf3-203c-4603-8660-13b62845322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7656dcf3-203c-4603-8660-13b62845322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63b0eb1-a955-46fc-9616-95d0572d232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:07 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63b0eb1-a955-46fc-9616-95d0572d232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28fa96dd-4083-481a-bdcf-2ca48db653eb', 'volume_name': 'volume-28fa96dd-4083-481a-bdcf-2ca48db653eb', 'volume_size': 1, 'snapshot_id': 'ffc07109-99f4-4a93-97ff-374ee73de3fd'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1700b4-54af-4ac6-9eb7-f220f32cd7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1700b4-54af-4ac6-9eb7-f220f32cd7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a6d3f4-baa8-4171-a4c4-e263c12a4ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:07 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Volume 28fa96dd-4083-481a-bdcf-2ca48db653eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28fa96dd-4083-481a-bdcf-2ca48db653eb', 'volume_size': 1, 'snapshot_id': 'ffc07109-99f4-4a93-97ff-374ee73de3fd'} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 1073741824" returned: 0 in 0.639s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Acquiring lock "cinder-1ec98a99-be34-4d04-ac19-b1bf79391273-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Lock "cinder-1ec98a99-be34-4d04-ac19-b1bf79391273-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:07 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 Sep 01 11:31:07 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Acquiring lock "cinder-quobyte-1ec98a99-be34-4d04-ac19-b1bf79391273" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Lock "cinder-quobyte-1ec98a99-be34-4d04-ac19-b1bf79391273" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53972aa-808f-4502-afb4-f468951cf8d3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:08 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 Sep 01 11:31:08 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:08 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035" returned: 0 in 0.294s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.338s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-ffc07109-99f4-4a93-97ff-374ee73de3fd-28fa96dd-4083-481a-bdcf-2ca48db653eb" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e8771d-b08d-434d-9cf9-65adc7575f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ea732a-aaba-4ac3-90f7-7a0c02893035', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303eab17-ad9e-4923-97d6-10c0c1cc5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-ffc07109-99f4-4a93-97ff-374ee73de3fd-28fa96dd-4083-481a-bdcf-2ca48db653eb" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Creating volume 28fa96dd-4083-481a-bdcf-2ca48db653eb from snapshot ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-28fa96dd-4083-481a-bdcf-2ca48db653eb" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Volume volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 (25ea732a-aaba-4ac3-90f7-7a0c02893035): created successfully Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303eab17-ad9e-4923-97d6-10c0c1cc5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Flow 'volume_create_manager' (f8916c73-d098-4f73-99c5-db8c5e08f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-28fa96dd-4083-481a-bdcf-2ca48db653eb" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] snapshot: ffc07109-99f4-4a93-97ff-374ee73de3fd, volume: 28fa96dd-4083-481a-bdcf-2ca48db653eb, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:31:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2dbe28ae-a583-4cac-88f4-9271b4bddd5a tempest-AttachVolumeNegativeTest-911563986 None] Created volume successfully. Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a456236c-fd34-4642-872e-731a400defd7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:08 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:08 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273 Sep 01 11:31:08 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd Sep 01 11:31:08 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:08 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:08 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1ec98a99-be34-4d04-ac19-b1bf79391273" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Lock "cinder-quobyte-1ec98a99-be34-4d04-ac19-b1bf79391273" released by "delete_volume" :: held 0.777s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:08 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd" returned: 0 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37851d8f-9146-4664-9faa-1b05ffb5427d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[25315dc6-4b99-4d56-b716-7757e34a06d5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Created reservations ['3e2b94ea-710c-4331-bce1-b826e11aa1d0', '96751f73-0194-4243-8fd2-556fe488838f', 'e4542209-d9b1-47cd-9708-ae030b88cd8a', 'b228ab14-74e1-4426-b637-cf14958f8405'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:08 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:31:08 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:08 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:08 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:09 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.364s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:09 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Deleted volume successfully. Sep 01 11:31:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be5af67e-4106-4f15-9443-5dbe2b80baa7 tempest-AbsoluteLimitsTests-1194639644 None] Lock "cinder-1ec98a99-be34-4d04-ac19-b1bf79391273-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:09 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.626s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:09 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:31:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:09 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb Sep 01 11:31:09 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:15 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb" returned: 0 in 5.776s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7038265-695c-43cf-97e1-8f11c0634042]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:15 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:31:15 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:15 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.576s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:31:15 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Converted 1024.00 MB image at 177.24 MB/s Sep 01 11:31:15 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb is being set with open permissions: ugo+rw Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:15 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb Sep 01 11:31:15 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:15 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-28fa96dd-4083-481a-bdcf-2ca48db653eb" released by "_copy_volume_from_snapshot" :: held 7.814s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-ffc07109-99f4-4a93-97ff-374ee73de3fd-28fa96dd-4083-481a-bdcf-2ca48db653eb" released by "_create_volume_from_snapshot" :: held 7.876s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.908s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.781s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aaddc3-3fde-44dd-9ab2-b6f982562ba1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a6d3f4-baa8-4171-a4c4-e263c12a4ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fa96dd-4083-481a-bdcf-2ca48db653eb', 'volume_size': 1, 'snapshot_id': 'ffc07109-99f4-4a93-97ff-374ee73de3fd'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f418b30-d106-4547-97b4-b8083a143290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Volume volume-28fa96dd-4083-481a-bdcf-2ca48db653eb (28fa96dd-4083-481a-bdcf-2ca48db653eb): created successfully Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f418b30-d106-4547-97b4-b8083a143290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Flow 'volume_create_manager' (045e4c65-5ef5-4b66-a2d8-9592076519fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0eb1b241-ad19-42d8-8e86-aa3bd0cbf7ca tempest-VolumesSnapshotTestJSON-1325444229 None] Created volume successfully. Sep 01 11:31:16 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 Sep 01 11:31:16 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:16 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035" returned: 0 in 0.422s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.449s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-25ea732a-aaba-4ac3-90f7-7a0c02893035', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c9854df-b8ce-488d-ba20-3a1738654196', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:31:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-f12b6c03-2061-45d1-8b58-ec09ee1eed22 req-dc7bd4ff-6161-45a8-b3e7-84893140dfc7 tempest-AttachVolumeNegativeTest-911563986 None] attachment_update completed successfully. Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-28fa96dd-4083-481a-bdcf-2ca48db653eb-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-28fa96dd-4083-481a-bdcf-2ca48db653eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-28fa96dd-4083-481a-bdcf-2ca48db653eb" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-28fa96dd-4083-481a-bdcf-2ca48db653eb" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b4398-ca9f-4386-8906-e02d934e92b2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:17 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb Sep 01 11:31:17 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:17 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb" returned: 0 in 0.511s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:17 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb Sep 01 11:31:17 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:17 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-28fa96dd-4083-481a-bdcf-2ca48db653eb" returned: 0 in 0.307s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-28fa96dd-4083-481a-bdcf-2ca48db653eb" released by "delete_volume" :: held 0.879s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['9fdc065c-b77d-495f-b69b-223fef59902a', '8bf6a368-2328-462f-b992-67d359d78ce8', '0e948c7f-128a-4fdc-8d0e-36596da871c1', 'e2ed1598-662b-4d5b-abb5-3d3eab81ccaa'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:18 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:18 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:18 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:18 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleted volume successfully. Sep 01 11:31:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-4195ac41-008d-41a0-acb0-47c99807b999 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-28fa96dd-4083-481a-bdcf-2ca48db653eb-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Flow 'volume_create_manager' (8a061bd9-0981-46b8-8b8f-dccec8bb2c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a4323c-3f80-4767-87de-f5c895e83045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a4323c-3f80-4767-87de-f5c895e83045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-700871838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf83b6d-6b83-4994-857b-ae79f029fa07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5627f548e0473bbf531c36f2f3865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:19Z,use_quota=True,user_id='b8307c929ec94755a71f7f2ab0405ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453fe33a-db03-48fe-8666-c30c670b0b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453fe33a-db03-48fe-8666-c30c670b0b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be22ce3-dc4f-48a5-8884-8ebfc89d7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be22ce3-dc4f-48a5-8884-8ebfc89d7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf83b6d-6b83-4994-857b-ae79f029fa07', 'volume_name': 'volume-3cf83b6d-6b83-4994-857b-ae79f029fa07', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa25c4b-3c4d-4176-ab98-914fab198d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa25c4b-3c4d-4176-ab98-914fab198d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e0eeb7-dd5c-46d6-ae26-fd942bc2797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:19 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Volume 3cf83b6d-6b83-4994-857b-ae79f029fa07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf83b6d-6b83-4994-857b-ae79f029fa07', 'volume_size': 1} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-700871838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf83b6d-6b83-4994-857b-ae79f029fa07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5627f548e0473bbf531c36f2f3865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:19Z,use_quota=True,user_id='b8307c929ec94755a71f7f2ab0405ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Creating volume 3cf83b6d-6b83-4994-857b-ae79f029fa07 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:19 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:19 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 1073741824 Sep 01 11:31:19 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-d37feb77-a13f-4bc1-af88-ac2631cf653c req-af6aef95-9235-48fb-b7c4-57ebdd51c022 tempest-AttachVolumeNegativeTest-911563986 None] Terminate volume connection completed successfully. Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-d37feb77-a13f-4bc1-af88-ac2631cf653c req-af6aef95-9235-48fb-b7c4-57ebdd51c022 tempest-AttachVolumeNegativeTest-911563986 None] Deleting attachment 7c9854df-b8ce-488d-ba20-3a1738654196. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-ffc07109-99f4-4a93-97ff-374ee73de3fd-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-ffc07109-99f4-4a93-97ff-374ee73de3fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-37851d8f-9146-4664-9faa-1b05ffb5427d" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-37851d8f-9146-4664-9faa-1b05ffb5427d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-ffc07109-99f4-4a93-97ff-374ee73de3fd" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-ffc07109-99f4-4a93-97ff-374ee73de3fd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleting offline snapshot ffc07109-99f4-4a93-97ff-374ee73de3fd of volume 37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] snapshot_file for this snap is: volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[855b3991-0a9d-49f2-b422-aec4bfd77af6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:19 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd Sep 01 11:31:19 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:19 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 1073741824" returned: 0 in 0.600s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:19 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 Sep 01 11:31:19 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:19 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37851d8f-9146-4664-9faa-1b05ffb5427d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a72a09-3974-48d9-b2b2-8b6c38b5b79a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:20 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:31:20 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:20 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07" returned: 0 in 0.396s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e0eeb7-dd5c-46d6-ae26-fd942bc2797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf83b6d-6b83-4994-857b-ae79f029fa07', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bd43de-da0f-439d-89aa-28b63f03bd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:20 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Volume volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 (3cf83b6d-6b83-4994-857b-ae79f029fa07): created successfully Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bd43de-da0f-439d-89aa-28b63f03bd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Flow 'volume_create_manager' (8a061bd9-0981-46b8-8b8f-dccec8bb2c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:20 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-41a63f7a-71a3-4ad3-853d-a8abf28e58f5 tempest-VolumesTransfersV357Test-1759843408 None] Created volume successfully. Sep 01 11:31:20 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.550s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:20 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd Sep 01 11:31:20 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:21 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd" returned: 0 in 0.621s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:21 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd Sep 01 11:31:21 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:21 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d.ffc07109-99f4-4a93-97ff-374ee73de3fd" returned: 0 in 0.340s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-ffc07109-99f4-4a93-97ff-374ee73de3fd" released by "_delete_snapshot" :: held 2.144s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-37851d8f-9146-4664-9faa-1b05ffb5427d" released by "delete_snapshot" :: held 2.182s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['11882030-70e8-4050-a845-083e62daebf1', '39b86c79-f477-41fc-99ad-12281b87c9f1', '2f398e53-35d0-4e30-bf31-580738acbea4', 'f123dd5b-d250-4e29-b45e-3a4206438954'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Delete snapshot completed successfully. Sep 01 11:31:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b2abf778-004d-4d7b-819a-7bf7731c0b50 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-ffc07109-99f4-4a93-97ff-374ee73de3fd-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4c885f0c-70db-4671-aadd-3a8bd1d9fafe tempest-VolumesTransfersV357Test-723986370 None] Transfer volume completed successfully. Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-37851d8f-9146-4664-9faa-1b05ffb5427d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-37851d8f-9146-4664-9faa-1b05ffb5427d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-37851d8f-9146-4664-9faa-1b05ffb5427d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-37851d8f-9146-4664-9faa-1b05ffb5427d" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b6ae40-94b3-4ae0-9acd-ff9fb7d381dd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Acquiring lock "cinder-3cf83b6d-6b83-4994-857b-ae79f029fa07-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-3cf83b6d-6b83-4994-857b-ae79f029fa07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:22 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:31:22 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Acquiring lock "cinder-quobyte-3cf83b6d-6b83-4994-857b-ae79f029fa07" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-quobyte-3cf83b6d-6b83-4994-857b-ae79f029fa07" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[141f2e5b-1ee2-4eda-a0af-ef086d404c30]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:23 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 Sep 01 11:31:23 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:23 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.504s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:23 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d Sep 01 11:31:23 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:23 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07" returned: 0 in 0.515s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:23 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-37851d8f-9146-4664-9faa-1b05ffb5427d" returned: 0 in 0.320s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:23 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07 Sep 01 11:31:23 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-37851d8f-9146-4664-9faa-1b05ffb5427d" released by "delete_volume" :: held 0.929s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['f258234f-c841-42be-836b-d963dcd48c6d', '31d08ac4-07cd-47c4-b1f4-4c0b74780625', '779fcca9-4291-4f66-9578-4727470c542b', '9a3df069-fa44-4ec6-9af8-b8c18ec71ba0'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:23 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:23 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:23 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3cf83b6d-6b83-4994-857b-ae79f029fa07" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-quobyte-3cf83b6d-6b83-4994-857b-ae79f029fa07" released by "delete_volume" :: held 0.882s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Created reservations ['4464c5e3-92c1-4412-bb2b-4447c637e37b', '201ade8a-0225-443f-810f-bbebf58ed9f6', '12f53892-ff5a-415c-8678-521e36e78ced', '6eaa2703-c69f-4542-b1b2-ba51934c4ab8'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:24 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:24 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:24 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.428s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleted volume successfully. Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8df18f7f-cc04-479a-8743-e70ebd862725 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-37851d8f-9146-4664-9faa-1b05ffb5427d-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:24 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.419s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Deleted volume successfully. Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-948ee85d-bf5e-4ef8-a226-eeded5c3fbf0 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-3cf83b6d-6b83-4994-857b-ae79f029fa07-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Flow 'volume_create_manager' (5900f56d-5cc9-4dd2-8d6b-8087318cbf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0b1cfa-0eb6-47ba-a2e2-07c2bb4dd648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0b1cfa-0eb6-47ba-a2e2-07c2bb4dd648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-878681155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d1b87f-e093-4588-81ab-096bb9d40e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5627f548e0473bbf531c36f2f3865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:25Z,use_quota=True,user_id='b8307c929ec94755a71f7f2ab0405ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762921be-dcbf-44d8-8393-05f809f2f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762921be-dcbf-44d8-8393-05f809f2f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbe4000-5478-46a2-a404-69a7ae656c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbe4000-5478-46a2-a404-69a7ae656c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d1b87f-e093-4588-81ab-096bb9d40e34', 'volume_name': 'volume-d8d1b87f-e093-4588-81ab-096bb9d40e34', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635243f3-abd2-46af-8d09-a336ba293896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635243f3-abd2-46af-8d09-a336ba293896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60e31a7-773c-4e26-9f6a-023ca30bb1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:25 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Volume d8d1b87f-e093-4588-81ab-096bb9d40e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d1b87f-e093-4588-81ab-096bb9d40e34', 'volume_size': 1} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-878681155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d1b87f-e093-4588-81ab-096bb9d40e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5627f548e0473bbf531c36f2f3865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:25Z,use_quota=True,user_id='b8307c929ec94755a71f7f2ab0405ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Creating volume d8d1b87f-e093-4588-81ab-096bb9d40e34 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:25 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-f3e09490-27d1-4ce6-a52f-3490ebbec780-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:25 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 1073741824 Sep 01 11:31:25 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-f3e09490-27d1-4ce6-a52f-3490ebbec780-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "cinder-quobyte-f3e09490-27d1-4ce6-a52f-3490ebbec780" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-f3e09490-27d1-4ce6-a52f-3490ebbec780" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e8244-ea93-460c-a7de-23930aa15ecc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:25 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 Sep 01 11:31:25 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:25 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 1073741824" returned: 0 in 0.605s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:25 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780" returned: 0 in 0.512s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:25 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780 Sep 01 11:31:25 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:25 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 Sep 01 11:31:25 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:26 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:26 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f3e09490-27d1-4ce6-a52f-3490ebbec780" returned: 0 in 0.315s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60e31a7-773c-4e26-9f6a-023ca30bb1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d1b87f-e093-4588-81ab-096bb9d40e34', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3520e7d9-601b-4142-bd41-5968fc21ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-quobyte-f3e09490-27d1-4ce6-a52f-3490ebbec780" released by "delete_volume" :: held 0.911s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:26 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Volume volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 (d8d1b87f-e093-4588-81ab-096bb9d40e34): created successfully Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3520e7d9-601b-4142-bd41-5968fc21ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Flow 'volume_create_manager' (5900f56d-5cc9-4dd2-8d6b-8087318cbf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-704130ea-df49-4b01-a1ca-b6570bc863ce tempest-VolumesTransfersV357Test-1759843408 None] Created volume successfully. Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Created reservations ['9dce371e-2c1f-4714-b057-83c5e52222a6', '5bf3a616-74cf-43df-a018-b1d1109176f9', '96acef44-55f7-48fe-b83e-0e8bc1569bc0', 'bbfa3f67-dacd-4b78-b5f2-06b46b67e1f6'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:26 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:26 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:26 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.252s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Deleted volume successfully. Sep 01 11:31:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7875dfa4-60f6-4674-8f51-066652ad7a69 tempest-VolumesSnapshotTestJSON-1325444229 None] Lock "cinder-f3e09490-27d1-4ce6-a52f-3490ebbec780-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Acquiring lock "cinder-d8d1b87f-e093-4588-81ab-096bb9d40e34-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-d8d1b87f-e093-4588-81ab-096bb9d40e34-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Acquiring lock "cinder-quobyte-d8d1b87f-e093-4588-81ab-096bb9d40e34" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-quobyte-d8d1b87f-e093-4588-81ab-096bb9d40e34" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[52efbc33-7213-47cb-879d-fb639e2fd185]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:27 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 Sep 01 11:31:27 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:27 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34" returned: 0 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:27 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34 Sep 01 11:31:27 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:28 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d8d1b87f-e093-4588-81ab-096bb9d40e34" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-quobyte-d8d1b87f-e093-4588-81ab-096bb9d40e34" released by "delete_volume" :: held 0.740s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Created reservations ['ea7bb3a3-4053-4ad5-965d-2e6f018cabcd', '7ab1f20e-37d4-488f-89f4-4ffd2b28e66f', '4e1ab21b-7ad4-4fa7-9697-8cc52c139e65', '8f7e885f-e23f-49c8-b1e5-1fdc91e4e602'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:28 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:28 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:28 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.344s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:28 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Deleted volume successfully. Sep 01 11:31:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f529adb8-0116-4c69-8e59-ff141aba8f78 tempest-VolumesTransfersV357Test-2081114381 None] Lock "cinder-d8d1b87f-e093-4588-81ab-096bb9d40e34-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:38 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=77,cinder:SELECT=69,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:31:38 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=52,cinder:UPDATE=79,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Flow 'volume_create_manager' (ff568c7b-24aa-48cb-9fdb-d19ab3d68f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44b0131-2c70-4e63-aa30-93861990839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44b0131-2c70-4e63-aa30-93861990839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-340563849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b439235-88e2-40e5-b560-34711354cd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0a4a4f0f184446af92297d815946a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:39Z,use_quota=True,user_id='419bd67723ba459581cb1173cb2235d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704ee397-7c8c-4b53-9bdf-78ea3dab4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704ee397-7c8c-4b53-9bdf-78ea3dab4edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974012c1-f850-4c11-b2ed-eae47c69d3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974012c1-f850-4c11-b2ed-eae47c69d3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b439235-88e2-40e5-b560-34711354cd43', 'volume_name': 'volume-2b439235-88e2-40e5-b560-34711354cd43', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2f2d61-7e15-4b60-a834-6ecb8085de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2f2d61-7e15-4b60-a834-6ecb8085de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dce802-9868-42a6-bbdf-59f07607b6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Volume 2b439235-88e2-40e5-b560-34711354cd43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b439235-88e2-40e5-b560-34711354cd43', 'volume_size': 1} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-340563849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b439235-88e2-40e5-b560-34711354cd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0a4a4f0f184446af92297d815946a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:39Z,use_quota=True,user_id='419bd67723ba459581cb1173cb2235d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Creating volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:39 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:39 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 1073741824 Sep 01 11:31:39 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (8251dec5-3b4c-4d41-94bc-d6429a94a86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21517e73-df19-4050-afb3-dbbf4db82854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21517e73-df19-4050-afb3-dbbf4db82854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-680595454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89e0a7d-fda6-4a61-b535-08884da1c9ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:40Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee50a661-514d-4b6e-8285-fe652cded2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee50a661-514d-4b6e-8285-fe652cded2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19167b5b-9771-436f-9786-1f57bc93b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19167b5b-9771-436f-9786-1f57bc93b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89e0a7d-fda6-4a61-b535-08884da1c9ab', 'volume_name': 'volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa513b64-43f4-471e-b8bc-92be8e259b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa513b64-43f4-471e-b8bc-92be8e259b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b841607-ace8-4d8d-a717-5e5c1deee431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Volume f89e0a7d-fda6-4a61-b535-08884da1c9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab', 'volume_size': 1} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:40 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 1073741824" returned: 0 in 0.640s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:40 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 Sep 01 11:31:40 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:40 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43" returned: 0 in 0.366s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-680595454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89e0a7d-fda6-4a61-b535-08884da1c9ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:40Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Creating volume f89e0a7d-fda6-4a61-b535-08884da1c9ab {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:40 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:40 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab 1073741824 Sep 01 11:31:40 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dce802-9868-42a6-bbdf-59f07607b6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b439235-88e2-40e5-b560-34711354cd43', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31500b56-0b1a-4c1f-960f-e1c158b05bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Volume volume-2b439235-88e2-40e5-b560-34711354cd43 (2b439235-88e2-40e5-b560-34711354cd43): created successfully Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31500b56-0b1a-4c1f-960f-e1c158b05bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Flow 'volume_create_manager' (ff568c7b-24aa-48cb-9fdb-d19ab3d68f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fb130257-b65d-454c-9452-4d6de2d25871 tempest-VolumesSnapshotListTestJSON-1189543800 None] Created volume successfully. Sep 01 11:31:41 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab 1073741824" returned: 0 in 0.685s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:41 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab Sep 01 11:31:41 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:41 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab" returned: 0 in 0.650s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b841607-ace8-4d8d-a717-5e5c1deee431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94e22c2-9219-40e2-9602-5c9438c67777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Volume volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab (f89e0a7d-fda6-4a61-b535-08884da1c9ab): created successfully Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94e22c2-9219-40e2-9602-5c9438c67777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (8251dec5-3b4c-4d41-94bc-d6429a94a86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Creating offline snapshot 53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a of volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:31:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-358ac9e8-b390-4393-8d2a-de65b32a3b26 tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab91a432-2094-495b-8224-2ddd792b529f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:42 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 Sep 01 11:31:42 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:42 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43" returned: 0 in 0.571s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:42 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a 1G Sep 01 11:31:42 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:43 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a 1G" returned: 0 in 0.740s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:43 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:31:43 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:43 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.364s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:43 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a is being set with open permissions: ugo+rw Sep 01 11:31:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:43 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:31:43 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:44 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:44 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info Sep 01 11:31:44 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (f32df728-580c-4503-880c-1842a4cdb12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d658afa1-0610-47a3-bbf5-4af2540a797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d658afa1-0610-47a3-bbf5-4af2540a797d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-222678614',display_name='tempest-VolumesGetTest-Volume-1940480288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d77514d-2874-4c38-9753-877eeb6c61a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:44Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6700a1e6-f71d-4147-a0ca-3ab4e42c48d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6700a1e6-f71d-4147-a0ca-3ab4e42c48d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df7916b-c7f0-4873-8068-7b7d1eb12691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df7916b-c7f0-4873-8068-7b7d1eb12691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d77514d-2874-4c38-9753-877eeb6c61a2', 'volume_name': 'volume-8d77514d-2874-4c38-9753-877eeb6c61a2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62888bb-d245-42e2-8153-70d2ba22e398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62888bb-d245-42e2-8153-70d2ba22e398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d48963-8ec0-4c41-9ed0-e176ac17f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Volume 8d77514d-2874-4c38-9753-877eeb6c61a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d77514d-2874-4c38-9753-877eeb6c61a2', 'volume_size': 1} Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:44 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info" returned: 0 in 0.445s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:44 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info is being set with open permissions: ugo+rw Sep 01 11:31:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:44 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info Sep 01 11:31:44 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:45 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.info" returned: 0 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.256s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-222678614',display_name='tempest-VolumesGetTest-Volume-1940480288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d77514d-2874-4c38-9753-877eeb6c61a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:44Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Creating volume 8d77514d-2874-4c38-9753-877eeb6c61a2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:45 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:45 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 1073741824 Sep 01 11:31:45 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-499dd79a-4137-40da-ae67-685fc1bb97b2 tempest-VolumesSnapshotListTestJSON-1189543800 None] Create snapshot completed successfully Sep 01 11:31:46 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 1073741824" returned: 0 in 0.877s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:46 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 Sep 01 11:31:46 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:46 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2" returned: 0 in 0.284s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d48963-8ec0-4c41-9ed0-e176ac17f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d77514d-2874-4c38-9753-877eeb6c61a2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea74f84-6dd5-4efc-ba4e-4af1805de9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:46 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Volume volume-8d77514d-2874-4c38-9753-877eeb6c61a2 (8d77514d-2874-4c38-9753-877eeb6c61a2): created successfully Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea74f84-6dd5-4efc-ba4e-4af1805de9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (f32df728-580c-4503-880c-1842a4cdb12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-56b3c51c-f02c-45a2-b32c-6b0f766aa6dd tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Creating offline snapshot e96d2736-a9af-4660-84fa-9dfd26916a6e of volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663e626-6062-46bc-9543-76588666bde0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:46 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:31:46 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:47 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.466s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:47 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e 1G Sep 01 11:31:47 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:47 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e 1G" returned: 0 in 0.553s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:47 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:47 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-8d77514d-2874-4c38-9753-877eeb6c61a2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Lock "cinder-8d77514d-2874-4c38-9753-877eeb6c61a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-8d77514d-2874-4c38-9753-877eeb6c61a2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-8d77514d-2874-4c38-9753-877eeb6c61a2" acquired by "delete_volume" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f932c-b976-4253-983b-a9b8c4ba90fc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:48 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.478s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:48 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e is being set with open permissions: ugo+rw Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:48 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 Sep 01 11:31:48 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:48 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:48 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:48 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:48 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2" returned: 0 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:48 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2 Sep 01 11:31:48 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7e21bf55-a0a9-40f7-a8ab-de2f5266364b tempest-VolumesSnapshotListTestJSON-1189543800 None] Create snapshot completed successfully Sep 01 11:31:49 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8d77514d-2874-4c38-9753-877eeb6c61a2" returned: 0 in 0.488s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-8d77514d-2874-4c38-9753-877eeb6c61a2" released by "delete_volume" :: held 1.044s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Created reservations ['6b638bf8-0c0f-4228-8cca-4f9e95851467', '6d95800f-8e48-4590-b3a3-c9ad7a6e2f3a', 'c06a821f-f09e-4367-9b02-e0b3c78c7cf2', '333ae41d-2eb8-42e3-8d2f-cb488c052091'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Creating offline snapshot 12db950b-2960-40f4-abd9-199317b0940b of volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[797159d7-b143-4e59-a3c9-a9ed0030401f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:49 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:49 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:49 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:49 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:49 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.339s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5904b009-8cc8-418e-b0de-8cef0282e14e tempest-VolumesGetTest-1406994654 None] Lock "cinder-8d77514d-2874-4c38-9753-877eeb6c61a2-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:49 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.531s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:49 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b 1G Sep 01 11:31:49 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:50 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b 1G" returned: 0 in 0.598s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-f89e0a7d-fda6-4a61-b535-08884da1c9ab-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:50 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Lock "cinder-f89e0a7d-fda6-4a61-b535-08884da1c9ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:50 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-f89e0a7d-fda6-4a61-b535-08884da1c9ab" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-f89e0a7d-fda6-4a61-b535-08884da1c9ab" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e533195-47ee-45e7-8142-b02c45100600]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:50 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab Sep 01 11:31:50 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:50 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b" returned: 0 in 0.438s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:50 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b is being set with open permissions: ugo+rw Sep 01 11:31:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:50 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b Sep 01 11:31:50 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:51 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab" returned: 0 in 0.581s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:51 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab Sep 01 11:31:51 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:51 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b" returned: 0 in 0.421s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1175b649-e853-437e-a23a-b85f56bc5247 tempest-VolumesSnapshotListTestJSON-1189543800 None] Create snapshot completed successfully Sep 01 11:31:51 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f89e0a7d-fda6-4a61-b535-08884da1c9ab" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-f89e0a7d-fda6-4a61-b535-08884da1c9ab" released by "delete_volume" :: held 0.966s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Created reservations ['ece7d06e-aac6-4548-add6-1e07cab2f9e4', '7c1ce4a0-f251-4f65-b610-91dd0d5bf192', 'c68ef77e-a897-4412-9017-8aef6645ee4d', '65c29924-2997-43ca-9c92-6c6d4adeda31'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:51 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:31:51 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:52 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.291s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:52 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:31:52 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:31:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d11a9ce0-68dd-4a68-b360-c174ab49d78e tempest-VolumesGetTest-1406994654 None] Lock "cinder-f89e0a7d-fda6-4a61-b535-08884da1c9ab-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-12db950b-2960-40f4-abd9-199317b0940b-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-12db950b-2960-40f4-abd9-199317b0940b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-12db950b-2960-40f4-abd9-199317b0940b" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-12db950b-2960-40f4-abd9-199317b0940b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Deleting offline snapshot 12db950b-2960-40f4-abd9-199317b0940b of volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] snapshot_file for this snap is: volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0258acad-47ae-4965-8e2e-46c6188ece6a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (50f5ea06-3d83-43d1-98f3-0c346e075f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2c887a-81e8-49be-87d4-be8f42d6e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2c887a-81e8-49be-87d4-be8f42d6e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-412021993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e51a973-956f-4939-a790-e6f70eb001e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:53Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c84bf7f-52db-4e73-b57b-849deb4eb0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c84bf7f-52db-4e73-b57b-849deb4eb0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b424555d-ee41-4c09-b035-da4d5d83b1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b424555d-ee41-4c09-b035-da4d5d83b1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e51a973-956f-4939-a790-e6f70eb001e5', 'volume_name': 'volume-4e51a973-956f-4939-a790-e6f70eb001e5', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe96ab9-8a66-4b03-b0b9-e2621c5b5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe96ab9-8a66-4b03-b0b9-e2621c5b5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d2b501-eef8-4b6d-a35f-34c4e8cd78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:53 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Volume 4e51a973-956f-4939-a790-e6f70eb001e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e51a973-956f-4939-a790-e6f70eb001e5', 'volume_size': 1} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-412021993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e51a973-956f-4939-a790-e6f70eb001e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:53Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Creating volume 4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:53 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:31:53 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:31:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:53 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:53 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 1073741824 Sep 01 11:31:53 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:54 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b" returned: 0 in 0.772s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[234bb1f5-e54e-40a7-976d-cc91a5226276]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:54 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:54 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:54 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 1073741824" returned: 0 in 0.727s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:54 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:31:54 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:54 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.539s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:54 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b Sep 01 11:31:54 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:54 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d2b501-eef8-4b6d-a35f-34c4e8cd78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e51a973-956f-4939-a790-e6f70eb001e5', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78178a64-33ce-48a7-a256-92213a897646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:54 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Volume volume-4e51a973-956f-4939-a790-e6f70eb001e5 (4e51a973-956f-4939-a790-e6f70eb001e5): created successfully Sep 01 11:31:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78178a64-33ce-48a7-a256-92213a897646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (50f5ea06-3d83-43d1-98f3-0c346e075f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:55 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0b4307c8-694e-4b34-8e1c-86e3990e25e8 tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:31:55 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b" returned: 0 in 0.562s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:55 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b Sep 01 11:31:55 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:55 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.12db950b-2960-40f4-abd9-199317b0940b" returned: 0 in 0.371s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-12db950b-2960-40f4-abd9-199317b0940b" released by "_delete_snapshot" :: held 2.410s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" released by "delete_snapshot" :: held 2.443s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Created reservations ['ae896288-e916-4992-be89-0997a3f8d1e2', '57723374-6a72-40d7-8f21-c751cf3441ca', '4a12819c-a9ae-45d3-9cec-412e665e5246', '44bb6493-a982-4b0c-85e3-205b9ae4ed8e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:55 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Delete snapshot completed successfully. Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bfd25552-4985-4bf7-b2a7-ce27a79b20ef tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-12db950b-2960-40f4-abd9-199317b0940b-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (3a042906-21cb-44ac-b760-d8195f27671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ced1c00-8ea8-4c36-a148-001a9cd73cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ced1c00-8ea8-4c36-a148-001a9cd73cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1348106294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9248366-9824-4e81-b7d8-e7e0ad7b4645,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4e51a973-956f-4939-a790-e6f70eb001e5,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:56Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e65e521-da04-4897-a152-171db2b79922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e65e521-da04-4897-a152-171db2b79922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45e14e8-54bf-4a51-9268-2fe748dc3642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45e14e8-54bf-4a51-9268-2fe748dc3642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd9248366-9824-4e81-b7d8-e7e0ad7b4645', 'volume_name': 'volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645', 'volume_size': 1, 'source_volid': '4e51a973-956f-4939-a790-e6f70eb001e5', 'source_volstatus': 'available'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a6b69c-90ea-4a31-91bd-981976a39ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a6b69c-90ea-4a31-91bd-981976a39ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b22f11-25aa-4b11-8c05-114c3dd7cd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Volume d9248366-9824-4e81-b7d8-e7e0ad7b4645: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645', 'volume_size': 1, 'source_volid': '4e51a973-956f-4939-a790-e6f70eb001e5', 'source_volstatus': 'available'} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:56 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Cloning volume 4e51a973-956f-4939-a790-e6f70eb001e5 to volume d9248366-9824-4e81-b7d8-e7e0ad7b4645 Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Creating offline snapshot 89fe2b09-079d-4816-aa66-bd51ab54ac52 of volume 4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bc4ccd-e86a-4708-9530-70df97747c3d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:56 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:31:56 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-e96d2736-a9af-4660-84fa-9dfd26916a6e-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-e96d2736-a9af-4660-84fa-9dfd26916a6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-e96d2736-a9af-4660-84fa-9dfd26916a6e" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-e96d2736-a9af-4660-84fa-9dfd26916a6e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Deleting offline snapshot e96d2736-a9af-4660-84fa-9dfd26916a6e of volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] snapshot_file for this snap is: volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b15af-08ec-4764-986b-7405d35f048a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:56 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:56 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 1G Sep 01 11:31:56 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:56 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:56 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:57 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c136310-924b-4381-a9ab-579cf396520a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:57 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 1G" returned: 0 in 0.468s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e51a973-956f-4939-a790-e6f70eb001e5 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:57 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e51a973-956f-4939-a790-e6f70eb001e5 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 Sep 01 11:31:57 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:57 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:31:57 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:57 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e51a973-956f-4939-a790-e6f70eb001e5 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52" returned: 0 in 0.336s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:57 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 is being set with open permissions: ugo+rw Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:57 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:57 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 Sep 01 11:31:57 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:57 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:57 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Flow 'volume_create_manager' (0ab89520-2813-46d1-85a5-b9c3f4b52fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e826e679-658c-465a-9abc-f2320d4730c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e826e679-658c-465a-9abc-f2320d4730c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-358615404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1bffbb-b14a-439c-b081-b1b361b85de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501940b1a7a94bc081ab510343f63efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:58Z,use_quota=True,user_id='caee6c13ffb14b789ba3c9b4a5b58366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b589e43c-e4aa-4c54-aaf3-197d13562bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b589e43c-e4aa-4c54-aaf3-197d13562bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a2bde7-44f8-4ad1-9ab5-1df7c09c1150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a2bde7-44f8-4ad1-9ab5-1df7c09c1150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1bffbb-b14a-439c-b081-b1b361b85de4', 'volume_name': 'volume-2b1bffbb-b14a-439c-b081-b1b361b85de4', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b5d76d-7485-4005-ad99-c0087e70b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b5d76d-7485-4005-ad99-c0087e70b348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f705bf9-dc2e-4adc-950b-a19e01e1b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:31:57 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Volume 2b1bffbb-b14a-439c-b081-b1b361b85de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1bffbb-b14a-439c-b081-b1b361b85de4', 'volume_size': 1} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:57 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52" returned: 0 in 0.284s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:57 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info Sep 01 11:31:57 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:58 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.465s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:58 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e Sep 01 11:31:58 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:58 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:58 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info is being set with open permissions: ugo+rw Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:58 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info Sep 01 11:31:58 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:58 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.e96d2736-a9af-4660-84fa-9dfd26916a6e" returned: 0 in 0.288s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-e96d2736-a9af-4660-84fa-9dfd26916a6e" released by "_delete_snapshot" :: held 1.711s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" released by "delete_snapshot" :: held 1.742s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:58 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.info" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-d9248366-9824-4e81-b7d8-e7e0ad7b4645" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Created reservations ['4c317e1f-66db-45d3-826d-190ce233d5d3', 'f77fbf11-39fa-4e11-8c40-94b6bf6eab9d', 'aff5d49e-45f5-4b4b-9f13-b13386b7a6ca', 'c0789110-46bf-45f1-a41f-48fcb4451fcf'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-d9248366-9824-4e81-b7d8-e7e0ad7b4645" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] snapshot: 89fe2b09-079d-4816-aa66-bd51ab54ac52, volume: d9248366-9824-4e81-b7d8-e7e0ad7b4645, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c37e42-378e-4f38-b4f1-134355c6655d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Delete snapshot completed successfully. Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49153fef-1428-4406-8a11-4caf3b7ca26c tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-e96d2736-a9af-4660-84fa-9dfd26916a6e-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:31:58 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 Sep 01 11:31:58 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Deleting offline snapshot 53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a of volume 2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] snapshot_file for this snap is: volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[829f8be8-4ce9-43c8-a900-c70c44b170b4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:58 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52" returned: 0 in 0.415s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e51a973-956f-4939-a790-e6f70eb001e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d0fc2-ff05-4c5a-bf98-8699c3e07f88]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:59 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:31:59 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:59 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:31:59 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:59 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.449s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b439235-88e2-40e5-b560-34711354cd43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f549c4de-6a52-4dd2-86b9-922679e26048]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:59 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.432s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:59 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 Sep 01 11:31:59 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:59 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 Sep 01 11:31:59 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:31:59 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43" returned: 0 in 0.424s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:31:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:31:59 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:31:59 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:00 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.798s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:00 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a Sep 01 11:32:00 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:01 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43.53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" returned: 0 in 0.780s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a" released by "_delete_snapshot" :: held 2.652s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" released by "delete_snapshot" :: held 2.690s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:01 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Created reservations ['30ec7929-9238-4e18-9d95-78f3f6ee6759', 'deda9ad5-d61d-45c2-9eee-c00e23004783', 'ac5809f3-1fef-4dbc-80ed-ca585b259316', 'a02ca20c-1f5a-4a4b-b470-d2e2272c2569'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Delete snapshot completed successfully. Sep 01 11:32:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-743241d4-8667-4ad7-bf34-0bc24bc52bfc tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-53720bf5-cf4c-4aff-b1fd-bda4cff1fb5a-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-2b439235-88e2-40e5-b560-34711354cd43-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-2b439235-88e2-40e5-b560-34711354cd43-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[643571f0-e0b9-416d-922c-2676e1c0f31d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:02 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 Sep 01 11:32:02 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:03 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43" returned: 0 in 0.820s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:03 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43 Sep 01 11:32:03 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:04 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b439235-88e2-40e5-b560-34711354cd43" returned: 0 in 0.752s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-quobyte-2b439235-88e2-40e5-b560-34711354cd43" released by "delete_volume" :: held 1.768s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:04 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:04 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Created reservations ['c27eae22-47e6-4e44-ad0f-67bc2fa2e2d3', 'a582ddf1-600e-4cbd-88ef-57360112a925', '68e8e697-64b7-4291-b189-356866539647', 'f9544623-9a01-44ef-a251-602b26315ff3'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:05 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:05 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:05 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.952s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:32:05 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.693s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Deleted volume successfully. Sep 01 11:32:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1a160abc-778a-4e76-b576-ce943ef1544d tempest-VolumesSnapshotListTestJSON-1189543800 None] Lock "cinder-2b439235-88e2-40e5-b560-34711354cd43-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:06 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645" returned: 0 in 6.737s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3a57f-3c7a-4fd9-8352-94bb3bf1ebc5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:06 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:32:06 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Flow 'volume_create_manager' (4c70d725-47c8-4aff-bd72-13ba2ef46b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973cfb8e-b607-4c9d-bfb4-9ce55616e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973cfb8e-b607-4c9d-bfb4-9ce55616e882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-866353265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3384c6-f0a2-4459-a08d-1483a5e850fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401cfcd5f5654e808cb063f645dc6369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:07Z,use_quota=True,user_id='a64eba536af348a1b570dc3149e11c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f09db7-d8f0-43c3-a839-21f1dda397e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f09db7-d8f0-43c3-a839-21f1dda397e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beac566-0a72-4486-996b-fe0b398f663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beac566-0a72-4486-996b-fe0b398f663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3384c6-f0a2-4459-a08d-1483a5e850fb', 'volume_name': 'volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ede044c-68be-4760-8a2b-15cca4f7373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ede044c-68be-4760-8a2b-15cca4f7373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892470f9-4ac1-48ed-b8fa-33325079b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:06 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Volume 3a3384c6-f0a2-4459-a08d-1483a5e850fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb', 'volume_size': 1} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:06 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.770s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:32:06 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Converted 1024.00 MB image at 151.97 MB/s Sep 01 11:32:06 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 is being set with open permissions: ugo+rw Sep 01 11:32:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:07 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 Sep 01 11:32:07 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645" returned: 0 in 0.482s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:07 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-d9248366-9824-4e81-b7d8-e7e0ad7b4645" released by "_copy_volume_from_snapshot" :: held 8.985s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-89fe2b09-079d-4816-aa66-bd51ab54ac52" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-89fe2b09-079d-4816-aa66-bd51ab54ac52" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Deleting offline snapshot 89fe2b09-079d-4816-aa66-bd51ab54ac52 of volume 4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] snapshot_file for this snap is: volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[40acd01c-2682-482b-87ff-dd7965f6f031]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:07 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 Sep 01 11:32:07 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:08 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52" returned: 0 in 0.997s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e51a973-956f-4939-a790-e6f70eb001e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:32:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3676479d-ad59-49f0-8c63-7deede11a248]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:08 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:32:08 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:09 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.530s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:09 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 Sep 01 11:32:09 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:09 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52" returned: 0 in 0.487s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:09 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52 Sep 01 11:32:09 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:10 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5.89fe2b09-079d-4816-aa66-bd51ab54ac52" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-89fe2b09-079d-4816-aa66-bd51ab54ac52" released by "_delete_snapshot" :: held 2.587s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.966s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.483s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-358615404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1bffbb-b14a-439c-b081-b1b361b85de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501940b1a7a94bc081ab510343f63efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:31:58Z,use_quota=True,user_id='caee6c13ffb14b789ba3c9b4a5b58366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Creating volume 2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:10 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b22f11-25aa-4b11-8c05-114c3dd7cd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645', 'volume_size': 1, 'source_volid': '4e51a973-956f-4939-a790-e6f70eb001e5', 'source_volstatus': 'available'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a865a3-4027-46be-a355-dc3fbc137684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:10 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 1073741824 Sep 01 11:32:10 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:10 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Volume volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 (d9248366-9824-4e81-b7d8-e7e0ad7b4645): created successfully Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a865a3-4027-46be-a355-dc3fbc137684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (3a042906-21cb-44ac-b760-d8195f27671c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-017089f1-bd45-4fe8-987d-a7d05d40e43e tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:32:11 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 1073741824" returned: 0 in 1.104s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:11 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:32:11 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:11 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.345s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-866353265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3384c6-f0a2-4459-a08d-1483a5e850fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401cfcd5f5654e808cb063f645dc6369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:07Z,use_quota=True,user_id='a64eba536af348a1b570dc3149e11c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Creating volume 3a3384c6-f0a2-4459-a08d-1483a5e850fb {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:11 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f705bf9-dc2e-4adc-950b-a19e01e1b36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1bffbb-b14a-439c-b081-b1b361b85de4', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dd07d1-f644-4755-8a6d-b6d2636fcc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:11 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb 1073741824 Sep 01 11:32:11 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:11 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Volume volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 (2b1bffbb-b14a-439c-b081-b1b361b85de4): created successfully Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dd07d1-f644-4755-8a6d-b6d2636fcc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Flow 'volume_create_manager' (0ab89520-2813-46d1-85a5-b9c3f4b52fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-468881cf-36f1-4fb8-978d-7b6e97219409 tempest-TestStampPattern-930150698 None] Created volume successfully. Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (aa7b00ad-d1e7-4d7f-a6eb-e329da39a595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715a08af-7945-41f3-b674-abb1c6914700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715a08af-7945-41f3-b674-abb1c6914700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2007865407',display_name='tempest-VolumesGetTest-Volume-1532090301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebb807c-b879-4c9f-8568-50c067ffaaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:12Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbb5069-b886-4054-9c16-abbc1390bb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbb5069-b886-4054-9c16-abbc1390bb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c56dae-fbc3-4694-9ed6-eaba9bc4160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c56dae-fbc3-4694-9ed6-eaba9bc4160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebb807c-b879-4c9f-8568-50c067ffaaef', 'volume_name': 'volume-7ebb807c-b879-4c9f-8568-50c067ffaaef', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025dbf4a-9c93-40ba-a85e-0c6fed8fc762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025dbf4a-9c93-40ba-a85e-0c6fed8fc762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4513b1bb-6bfe-4dc5-860a-843eaad8210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:12 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Volume 7ebb807c-b879-4c9f-8568-50c067ffaaef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebb807c-b879-4c9f-8568-50c067ffaaef', 'volume_size': 1} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:12 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb 1073741824" returned: 0 in 0.815s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:12 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb Sep 01 11:32:12 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:13 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb" returned: 0 in 0.355s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2007865407',display_name='tempest-VolumesGetTest-Volume-1532090301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebb807c-b879-4c9f-8568-50c067ffaaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:12Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Creating volume 7ebb807c-b879-4c9f-8568-50c067ffaaef {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:13 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892470f9-4ac1-48ed-b8fa-33325079b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e5694d-7b16-498d-b139-590b790e0737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:13 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef 1073741824 Sep 01 11:32:13 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:13 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Volume volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb (3a3384c6-f0a2-4459-a08d-1483a5e850fb): created successfully Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e5694d-7b16-498d-b139-590b790e0737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Flow 'volume_create_manager' (4c70d725-47c8-4aff-bd72-13ba2ef46b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-62340c61-053f-48ed-bf5d-dcca7242c386 tempest-AttachVolumeNegativeTest-911563986 None] Created volume successfully. Sep 01 11:32:13 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef 1073741824" returned: 0 in 0.643s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:13 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef Sep 01 11:32:13 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:14 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4513b1bb-6bfe-4dc5-860a-843eaad8210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebb807c-b879-4c9f-8568-50c067ffaaef', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1ffb0b-3461-493d-8786-340ab2e2d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:14 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Volume volume-7ebb807c-b879-4c9f-8568-50c067ffaaef (7ebb807c-b879-4c9f-8568-50c067ffaaef): created successfully Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1ffb0b-3461-493d-8786-340ab2e2d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (aa7b00ad-d1e7-4d7f-a6eb-e329da39a595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:14 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1cec761f-3b0f-40e5-90c2-01d74088806a tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-7ebb807c-b879-4c9f-8568-50c067ffaaef-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Lock "cinder-7ebb807c-b879-4c9f-8568-50c067ffaaef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-7ebb807c-b879-4c9f-8568-50c067ffaaef" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-7ebb807c-b879-4c9f-8568-50c067ffaaef" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae218081-0bae-4eae-8864-b4e730cff1ff]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:15 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef Sep 01 11:32:15 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:15 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef" returned: 0 in 0.594s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da84277-f1ea-41f1-af73-4d083ca13558]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:15 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef Sep 01 11:32:15 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:15 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb Sep 01 11:32:15 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:15 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7ebb807c-b879-4c9f-8568-50c067ffaaef" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-7ebb807c-b879-4c9f-8568-50c067ffaaef" released by "delete_volume" :: held 0.964s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Created reservations ['03c37d6a-d68c-446d-ade5-4753894af2f4', '17a41908-c1df-49e3-85a0-a4bc0833ca84', '8e152cb2-240e-48fa-8407-757774436f43', 'efed7108-6c97-456c-8c29-a73561489510'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:15 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb" returned: 0 in 0.439s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.471s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8af0bfb-aabf-4610-938d-9bd21bef6c4a', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:16 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:16 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-adc29883-5fd0-4af8-8108-fc6b783a45a2 req-da7a8c47-16c3-4353-8251-4edb4a92bfa1 tempest-AttachVolumeNegativeTest-911563986 None] attachment_update completed successfully. Sep 01 11:32:16 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.614s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:16 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:32:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-db51762e-4aec-495b-895e-7dd3993bb5e8 tempest-VolumesGetTest-1406994654 None] Lock "cinder-7ebb807c-b879-4c9f-8568-50c067ffaaef-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-d9248366-9824-4e81-b7d8-e7e0ad7b4645-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Lock "cinder-d9248366-9824-4e81-b7d8-e7e0ad7b4645-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-d9248366-9824-4e81-b7d8-e7e0ad7b4645" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-d9248366-9824-4e81-b7d8-e7e0ad7b4645" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ae4bf-a479-44ae-b183-e7c9b6057205]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:17 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 Sep 01 11:32:17 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:17 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645" returned: 0 in 0.432s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:17 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645 Sep 01 11:32:17 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:18 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d9248366-9824-4e81-b7d8-e7e0ad7b4645" returned: 0 in 0.326s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-d9248366-9824-4e81-b7d8-e7e0ad7b4645" released by "delete_volume" :: held 0.826s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Created reservations ['2c3e1951-3864-4e0d-b0ca-abb28e6db2ad', '6b65416a-27e1-4f71-878d-ccb68c851418', '32bd2fa4-aee6-472e-af0e-2296a74202cd', 'f46a9cf9-bfa9-4229-8a18-598ad7c4c158'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:18 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:18 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-4e51a973-956f-4939-a790-e6f70eb001e5-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Lock "cinder-4e51a973-956f-4939-a790-e6f70eb001e5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-4e51a973-956f-4939-a790-e6f70eb001e5" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-4e51a973-956f-4939-a790-e6f70eb001e5" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a997ec47-fab3-4951-bc75-fb3eca67cb56]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:19 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.546s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:32:19 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:32:19 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1c1e6ce3-44a7-476a-bc9a-7af9d12991f6 tempest-VolumesGetTest-1406994654 None] Lock "cinder-d9248366-9824-4e81-b7d8-e7e0ad7b4645-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:19 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.679s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:19 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5 Sep 01 11:32:19 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:19 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4e51a973-956f-4939-a790-e6f70eb001e5" returned: 0 in 0.478s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-4e51a973-956f-4939-a790-e6f70eb001e5" released by "delete_volume" :: held 1.276s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:20 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-f9a8668b-84a9-4727-80f2-d7564e95169a req-13f3e53b-17b6-43e9-9e3f-e729a9271e59 tempest-AttachVolumeNegativeTest-911563986 None] Terminate volume connection completed successfully. Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-f9a8668b-84a9-4727-80f2-d7564e95169a req-13f3e53b-17b6-43e9-9e3f-e729a9271e59 tempest-AttachVolumeNegativeTest-911563986 None] Deleting attachment c8af0bfb-aabf-4610-938d-9bd21bef6c4a. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Created reservations ['4c6b619b-ff69-48d6-baad-3243ee3c4c22', 'c6258e6b-1687-4de9-8695-4f153e07eb5a', '11b408de-9e18-4e86-ad07-f0770293d820', '849e312b-6447-4fd4-98df-75e36f440ec1'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:20 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:20 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:20 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.437s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:20 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:32:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c0fba53b-b7ba-4fd2-ae79-fff67b8cedb7 tempest-VolumesGetTest-1406994654 None] Lock "cinder-4e51a973-956f-4939-a790-e6f70eb001e5-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (9f7818fd-af6f-4d6a-bfce-fbbf6f2e62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39d1ef9-b5d1-4520-b05b-3bc69fcdd467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39d1ef9-b5d1-4520-b05b-3bc69fcdd467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-653255196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78375d98-e1d0-4133-b76b-331c395fe11d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:22Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc96c8b9-d6da-4246-ad4a-0cae66870fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc96c8b9-d6da-4246-ad4a-0cae66870fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e824bed6-87b5-4788-b582-87215dbdff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:22 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e824bed6-87b5-4788-b582-87215dbdff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78375d98-e1d0-4133-b76b-331c395fe11d', 'volume_name': 'volume-78375d98-e1d0-4133-b76b-331c395fe11d', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80222085-0c5d-46dd-bf10-b08b3ec23b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80222085-0c5d-46dd-bf10-b08b3ec23b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36764184-39ae-466e-a591-b0fbd303c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Volume 78375d98-e1d0-4133-b76b-331c395fe11d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78375d98-e1d0-4133-b76b-331c395fe11d', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Trying to clone 78375d98-e1d0-4133-b76b-331c395fe11d from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:32:23 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Image download 20.69 MB at 20.69 MB/s Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a577cd-7ca0-42e8-9e63-345ebaa6943b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:23 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD Sep 01 11:32:23 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:24 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b is fetched for user f2b4cfb2abb6467fba9b7a1ec97f0aff. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b5259a-19a3-4ac8-9e79-a2bef8092867]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:24 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD Sep 01 11:32:24 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:24 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-653255196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78375d98-e1d0-4133-b76b-331c395fe11d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:22Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Creating volume 78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:24 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:24 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d 1073741824 Sep 01 11:32:24 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:25 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d 1073741824" returned: 0 in 0.612s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:25 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:25 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:25 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 0 in 0.285s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Attempting download of 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume 78375d98-e1d0-4133-b76b-331c395fe11d. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[356aa4e5-033a-4dc5-8baa-4110eefcc24f]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:25 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c Sep 01 11:32:25 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "cinder-3a3384c6-f0a2-4459-a08d-1483a5e850fb-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-3a3384c6-f0a2-4459-a08d-1483a5e850fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "cinder-quobyte-3a3384c6-f0a2-4459-a08d-1483a5e850fb" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-quobyte-3a3384c6-f0a2-4459-a08d-1483a5e850fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:26 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c" returned: 0 in 0.380s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d8fc9-0f53-40ae-8622-76578ecb77cd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:26 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c Sep 01 11:32:26 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:26 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb Sep 01 11:32:26 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:26 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c" returned: 1 in 0.419s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_j4quyv9c' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd17d24-8227-43da-88bc-9a891620e9bc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:26 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb" returned: 0 in 0.440s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:26 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb Sep 01 11:32:26 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:26 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD Sep 01 11:32:26 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:26 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-3a3384c6-f0a2-4459-a08d-1483a5e850fb" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-quobyte-3a3384c6-f0a2-4459-a08d-1483a5e850fb" released by "delete_volume" :: held 0.815s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:26 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b was qcow2, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:26 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:26 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Created reservations ['db51a3c8-2877-46e5-97bc-736f3224cc74', '01c21182-9d73-4a1e-b94b-b24bebc6fd54', '98277c4b-ce30-41b0-bce4-bbcad014f7de', '7610275d-4925-4347-b219-e9ae17381c9b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:27 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:27 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "cinder-25ea732a-aaba-4ac3-90f7-7a0c02893035-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-25ea732a-aaba-4ac3-90f7-7a0c02893035-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "cinder-quobyte-25ea732a-aaba-4ac3-90f7-7a0c02893035" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-quobyte-25ea732a-aaba-4ac3-90f7-7a0c02893035" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2cfa5-64da-479c-ab9f-8aceb7222c57]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:27 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.452s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Deleted volume successfully. Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3113a9a5-ec59-4d06-a916-617296948ac9 tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-3a3384c6-f0a2-4459-a08d-1483a5e850fb-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:27 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 Sep 01 11:32:27 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:27 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035" returned: 0 in 0.429s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:27 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035 Sep 01 11:32:27 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:28 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-25ea732a-aaba-4ac3-90f7-7a0c02893035" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-quobyte-25ea732a-aaba-4ac3-90f7-7a0c02893035" released by "delete_volume" :: held 0.757s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Created reservations ['49168d41-ffc8-4b14-8614-17dc195c87dc', '455ce930-8942-42ce-9d9d-66cf19503a8d', 'd3dcbb20-ec4b-4647-904a-bcbd95321231', 'e3a6dc6f-4ef1-48d3-ab64-4442f96c2d25'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:28 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:28 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:28 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.413s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "cinder-6dc00e13-afd8-4133-aef0-3358b210866d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:28 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Deleted volume successfully. Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-6dc00e13-afd8-4133-aef0-3358b210866d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:28 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-30965a2e-f6da-41e8-8b30-ff3721cc793e tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-25ea732a-aaba-4ac3-90f7-7a0c02893035-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 0 in 1.953s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_at0qtahvdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:32:28 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Converted 112.00 MB image at 57.32 MB/s Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:28 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d 1G Sep 01 11:32:28 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "cinder-quobyte-6dc00e13-afd8-4133-aef0-3358b210866d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-quobyte-6dc00e13-afd8-4133-aef0-3358b210866d" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e13b94c-eba0-450a-a7e3-b884365f05b8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:29 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d Sep 01 11:32:29 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:29 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d 1G" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0115f072-f58e-4218-8f6f-0f2d124090a5]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:29 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d" returned: 0 in 0.438s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:29 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d Sep 01 11:32:29 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:29 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:29 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:29 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6dc00e13-afd8-4133-aef0-3358b210866d" returned: 0 in 0.310s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-quobyte-6dc00e13-afd8-4133-aef0-3358b210866d" released by "delete_volume" :: held 0.815s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:29 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 0 in 0.550s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Created reservations ['21f93e54-b334-4e6b-b804-6ef1debae985', '8285fd33-f699-4e27-a96c-aff1a174a521', '5b5f5d12-6186-42a4-bbea-1ac251c67aa8', '038ac73b-2eaa-4d20-8427-1ac542b82e0a'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:29 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:29 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:30 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:30 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:30 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:30 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Deleted volume successfully. Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 1 in 0.518s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Downloaded image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume 78375d98-e1d0-4133-b76b-331c395fe11d successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b for user f2b4cfb2abb6467fba9b7a1ec97f0aff is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Marking volume 78375d98-e1d0-4133-b76b-331c395fe11d as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Copying metadata from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b to 78375d98-e1d0-4133-b76b-331c395fe11d. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Creating volume glance metadata for volume 78375d98-e1d0-4133-b76b-331c395fe11d backed by image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-072df508-329b-40bd-915b-772d497df35b tempest-AttachVolumeNegativeTest-911563986 None] Lock "cinder-6dc00e13-afd8-4133-aef0-3358b210866d-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36764184-39ae-466e-a591-b0fbd303c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78375d98-e1d0-4133-b76b-331c395fe11d', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2b29f5-a9cd-4ac1-b3a8-83e22fce4675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Volume volume-78375d98-e1d0-4133-b76b-331c395fe11d (78375d98-e1d0-4133-b76b-331c395fe11d): created successfully Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2b29f5-a9cd-4ac1-b3a8-83e22fce4675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (9f7818fd-af6f-4d6a-bfce-fbbf6f2e62ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-06030da4-cb88-4c05-bc1e-7b5b2e0b5343 tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (f5d74dae-6185-475a-936c-21d68252c998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2f895f-f22b-428a-81bc-23f5a684a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2f895f-f22b-428a-81bc-23f5a684a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1113676296',display_name='tempest-VolumesGetTest-Volume-818354670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93de4567-6598-4a32-b33a-8a3e9af77426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:32Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d58020-21e1-4d06-bf03-697acffe6812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d58020-21e1-4d06-bf03-697acffe6812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5b102d-87b2-4c1f-a7e7-02b6746999b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5b102d-87b2-4c1f-a7e7-02b6746999b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93de4567-6598-4a32-b33a-8a3e9af77426', 'volume_name': 'volume-93de4567-6598-4a32-b33a-8a3e9af77426', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ddc6f7-f3ab-4ac1-ad84-f50ed693f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ddc6f7-f3ab-4ac1-ad84-f50ed693f595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac705e8-33ca-4204-b12a-04e224cf6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Volume 93de4567-6598-4a32-b33a-8a3e9af77426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93de4567-6598-4a32-b33a-8a3e9af77426', 'volume_size': 1} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1113676296',display_name='tempest-VolumesGetTest-Volume-818354670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93de4567-6598-4a32-b33a-8a3e9af77426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac62cc813d4ca9820507a3e7b1b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:32Z,use_quota=True,user_id='f2b4cfb2abb6467fba9b7a1ec97f0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Creating volume 93de4567-6598-4a32-b33a-8a3e9af77426 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:32 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:32 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 1073741824 Sep 01 11:32:32 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:32 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 1073741824" returned: 0 in 0.565s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:32 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 Sep 01 11:32:32 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:33 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426" returned: 0 in 0.326s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac705e8-33ca-4204-b12a-04e224cf6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93de4567-6598-4a32-b33a-8a3e9af77426', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84a39e8-b599-4575-8a9d-61b094fd8a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Volume volume-93de4567-6598-4a32-b33a-8a3e9af77426 (93de4567-6598-4a32-b33a-8a3e9af77426): created successfully Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84a39e8-b599-4575-8a9d-61b094fd8a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Flow 'volume_create_manager' (f5d74dae-6185-475a-936c-21d68252c998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-70e9df2d-0c5b-4543-b90d-8c3e2285ee0a tempest-VolumesGetTest-1406994654 None] Created volume successfully. Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cf0378-1a4c-4651-91c9-cd68be79d296]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:34 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:32:34 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-93de4567-6598-4a32-b33a-8a3e9af77426-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Lock "cinder-93de4567-6598-4a32-b33a-8a3e9af77426-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-93de4567-6598-4a32-b33a-8a3e9af77426" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-93de4567-6598-4a32-b33a-8a3e9af77426" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b27df75-a9bb-42e3-ada9-3f6e2580246c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:34 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 Sep 01 11:32:34 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:34 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.657s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.689s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-2b1bffbb-b14a-439c-b081-b1b361b85de4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68016f4e-c349-4ae4-80a4-9f7aa04da2a4', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:32:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-9000c0fb-6a0d-41a3-a82e-637318ee1a20 req-7dd3ef35-977a-49e5-b62b-f478622d1ec3 tempest-TestStampPattern-930150698 None] attachment_update completed successfully. Sep 01 11:32:35 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426" returned: 0 in 0.544s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:35 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426 Sep 01 11:32:35 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:35 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-93de4567-6598-4a32-b33a-8a3e9af77426" returned: 0 in 0.381s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-93de4567-6598-4a32-b33a-8a3e9af77426" released by "delete_volume" :: held 0.991s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:35 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Created reservations ['1a011445-2ef2-485a-8761-90b8417c4224', '7a2f4a1d-86cc-489e-a113-e4bcbea88b4d', '3369a422-2103-4026-a725-e975b042178a', '08323090-673a-4a06-8ade-9aa2107d8a1b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:36 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:36 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:36 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-de33dcca-2ecb-4bba-8281-50e65802a057 tempest-VolumesGetTest-1406994654 None] Lock "cinder-93de4567-6598-4a32-b33a-8a3e9af77426-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-78375d98-e1d0-4133-b76b-331c395fe11d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Lock "cinder-78375d98-e1d0-4133-b76b-331c395fe11d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Acquiring lock "cinder-quobyte-78375d98-e1d0-4133-b76b-331c395fe11d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-78375d98-e1d0-4133-b76b-331c395fe11d" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[54417d9d-73d8-4bdb-992a-0558c5e6b680]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:37 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:37 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:37 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 0 in 0.521s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:37 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:37 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:38 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 1 in 0.529s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:38 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d Sep 01 11:32:38 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:38 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-78375d98-e1d0-4133-b76b-331c395fe11d" returned: 0 in 0.481s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Lock "cinder-quobyte-78375d98-e1d0-4133-b76b-331c395fe11d" released by "delete_volume" :: held 1.633s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=115,cinder:UPDATE=134,cinder:INSERT=39,cinder:DELETE=16 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=140,cinder:SELECT=122,cinder:DELETE=7,cinder:INSERT=39 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Created reservations ['07802d7f-3ebe-4a69-a900-290b7df4c5bf', '9af22540-ec87-41e4-9812-3e0c47581851', 'a2b61795-864f-4736-b77c-2858d7ee6cda', 'ecf426d7-56d4-4d2b-b26f-dd5d52f3ac9f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:39 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:39 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:39 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:39 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Deleted volume successfully. Sep 01 11:32:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b204f11a-7f5a-4b09-b518-4f36b8a78dc4 tempest-VolumesGetTest-1406994654 None] Lock "cinder-78375d98-e1d0-4133-b76b-331c395fe11d-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:32:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-f9710781-468f-4a22-b37d-6145fff6dc41 req-4c8339f8-4a84-4e68-83f1-53ab0c841d78 tempest-TestStampPattern-930150698 None] Terminate volume connection completed successfully. Sep 01 11:32:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-f9710781-468f-4a22-b37d-6145fff6dc41 req-4c8339f8-4a84-4e68-83f1-53ab0c841d78 tempest-TestStampPattern-930150698 None] Deleting attachment 68016f4e-c349-4ae4-80a4-9f7aa04da2a4. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:32:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Creating offline snapshot ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 of volume 2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:32:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fe1e4-7c48-401b-85c0-4f1f7cc9a5d7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:42 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:32:42 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:43 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.413s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:43 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 1G Sep 01 11:32:43 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:43 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 1G" returned: 0 in 0.586s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:43 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 Sep 01 11:32:43 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:44 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" returned: 0 in 0.465s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:44 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 is being set with open permissions: ugo+rw Sep 01 11:32:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:44 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 Sep 01 11:32:44 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:44 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:44 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info Sep 01 11:32:44 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:45 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Flow 'volume_create_manager' (c81bae49-b877-4bba-b86f-f7a03216ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11382022-a90b-4da5-99e8-513800ec0395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info" returned: 0 in 0.525s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:45 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info is being set with open permissions: ugo+rw Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:45 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info Sep 01 11:32:45 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11382022-a90b-4da5-99e8-513800ec0395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-693738014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7d7378-61ec-4826-b90e-2a94e0aed01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae285f7af06e4700a73fe23db71ef932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:45Z,use_quota=True,user_id='d326b7a6842c4419baa3c675cc4e16ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ff506be-7d49-40fe-9209-5d42199f52f9),volume_type_id=9ff506be-7d49-40fe-9209-5d42199f52f9)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c92e6b-61d3-4797-a7bb-d27ea1c7e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c92e6b-61d3-4797-a7bb-d27ea1c7e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034b2d9e-1ff7-4291-a5bc-dc84b251b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034b2d9e-1ff7-4291-a5bc-dc84b251b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7d7378-61ec-4826-b90e-2a94e0aed01c', 'volume_name': 'volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3d10df-40ff-4c4c-9865-a0cc6c810319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3d10df-40ff-4c4c-9865-a0cc6c810319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905c5175-f9bd-40b4-b989-94179799ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume 0c7d7378-61ec-4826-b90e-2a94e0aed01c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c', 'volume_size': 1} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Flow 'volume_create_manager' (e2278f0c-b2b1-4780-92eb-370ed6489ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8091687-2aa6-4876-9c57-120f852f9e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8091687-2aa6-4876-9c57-120f852f9e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-712311884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae285f7af06e4700a73fe23db71ef932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:45Z,use_quota=True,user_id='d326b7a6842c4419baa3c675cc4e16ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec1bfe7-9990-4f6d-a525-38d2d9448a04),volume_type_id=2ec1bfe7-9990-4f6d-a525-38d2d9448a04)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dedcba-a11a-4ec9-9348-683bdaacdf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dedcba-a11a-4ec9-9348-683bdaacdf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab56a4-1b61-4a51-9df0-3dc1ebe72514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab56a4-1b61-4a51-9df0-3dc1ebe72514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440', 'volume_name': 'volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66792422-fb90-42cd-8bd1-5d44a1bfee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66792422-fb90-42cd-8bd1-5d44a1bfee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f5b967-d731-4b07-98c5-b863bd3d688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440', 'volume_size': 1} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.info" returned: 0 in 0.501s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-693738014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7d7378-61ec-4826-b90e-2a94e0aed01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae285f7af06e4700a73fe23db71ef932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:45Z,use_quota=True,user_id='d326b7a6842c4419baa3c675cc4e16ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ff506be-7d49-40fe-9209-5d42199f52f9),volume_type_id=9ff506be-7d49-40fe-9209-5d42199f52f9)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Creating volume 0c7d7378-61ec-4826-b90e-2a94e0aed01c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:45 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:45 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c 1073741824 Sep 01 11:32:45 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4d8979e2-0faf-45e1-8c25-944c599e7e60 tempest-TestStampPattern-930150698 None] Create snapshot completed successfully Sep 01 11:32:46 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c 1073741824" returned: 0 in 0.668s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:46 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c Sep 01 11:32:46 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:46 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-712311884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae285f7af06e4700a73fe23db71ef932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:45Z,use_quota=True,user_id='d326b7a6842c4419baa3c675cc4e16ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec1bfe7-9990-4f6d-a525-38d2d9448a04),volume_type_id=2ec1bfe7-9990-4f6d-a525-38d2d9448a04)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Creating volume be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:46 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:46 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 1073741824 Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905c5175-f9bd-40b4-b989-94179799ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:46 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb82f55-3219-4713-94aa-0eea2d61e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Flow 'volume_create_manager' (8e83bac9-154a-4e78-8227-6c9073fb32ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e34ec4e-7de5-4443-bc6f-14099b266892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:46 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c (0c7d7378-61ec-4826-b90e-2a94e0aed01c): created successfully Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb82f55-3219-4713-94aa-0eea2d61e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Flow 'volume_create_manager' (c81bae49-b877-4bba-b86f-f7a03216ade1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e34ec4e-7de5-4443-bc6f-14099b266892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1009748105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9311d69b-93f4-43b4-952f-9c7c957a3fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae285f7af06e4700a73fe23db71ef932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:47Z,use_quota=True,user_id='d326b7a6842c4419baa3c675cc4e16ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(338d52a6-ba1e-4a18-b91b-0131acece360),volume_type_id=338d52a6-ba1e-4a18-b91b-0131acece360)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27789e4-2f1f-4c75-9afe-35128edc52b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27789e4-2f1f-4c75-9afe-35128edc52b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e6977b-7ca5-4bd8-adda-bf75b63096dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:32:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bad3fd99-6745-4d35-994f-e8590a705af7 tempest-TestInstancesWithCinderVolumes-38536295 None] Created volume successfully. Sep 01 11:32:47 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 1073741824" returned: 0 in 0.687s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e6977b-7ca5-4bd8-adda-bf75b63096dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9311d69b-93f4-43b4-952f-9c7c957a3fb1', 'volume_name': 'volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1', 'volume_size': 1, 'image_id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1905251172', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ae285f7af06e4700a73fe23db71ef932', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'created_at': datetime.datetime(2026, 9, 1, 9, 32, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 32, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe/file', 'properties': {}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4402396c-581e-4cd5-ba75-77a1e5b920d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4402396c-581e-4cd5-ba75-77a1e5b920d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9e268c-c69d-4ed9-99fc-4680f6ad5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:47 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume 9311d69b-93f4-43b4-952f-9c7c957a3fb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1', 'volume_size': 1, 'image_id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1905251172', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ae285f7af06e4700a73fe23db71ef932', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'created_at': datetime.datetime(2026, 9, 1, 9, 32, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 32, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe/file', 'properties': {}}, 'image_service': } Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Trying to clone 9311d69b-93f4-43b4-952f-9c7c957a3fb1 from image 9eb052e7-7bcb-4ec0-a571-b3180cac77fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:47 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 Sep 01 11:32:47 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:47 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" returned: 0 in 0.302s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f5b967-d731-4b07-98c5-b863bd3d688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149a0425-0014-4ac6-9830-aa8db4c75b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:47 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 (be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440): created successfully Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149a0425-0014-4ac6-9830-aa8db4c75b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Flow 'volume_create_manager' (e2278f0c-b2b1-4780-92eb-370ed6489ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f89e8946-f118-48dd-8f08-904be07ebd37 tempest-TestInstancesWithCinderVolumes-38536295 None] Created volume successfully. Sep 01 11:32:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6e9ef877-8a0f-4544-a308-30ff11046321 tempest-GroupsV320Test-317472701 None] Group tempest-GroupsV320Test-Group-1025256103: creating Sep 01 11:32:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6e9ef877-8a0f-4544-a308-30ff11046321 tempest-GroupsV320Test-317472701 None] Group tempest-GroupsV320Test-Group-1025256103: created successfully Sep 01 11:32:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6e9ef877-8a0f-4544-a308-30ff11046321 tempest-GroupsV320Test-317472701 None] Create group completed successfully. Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Created reservations ['81d2d1cf-b70a-43ad-8f52-36c0182114eb'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:50 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:32:50 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:51 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.402s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:51 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:32:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f8c61543-76d2-41d5-9fdb-6cab02408189 tempest-GroupsV320Test-317472701 None] Delete group completed successfully. Sep 01 11:32:52 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD, size 20.69 MB, duration 5.18 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:32:52 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Image download 20.69 MB at 4.00 MB/s Sep 01 11:32:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d0059b-0f20-48ac-be08-6467e91d302a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:52 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD Sep 01 11:32:52 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:53 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Temporary image 9eb052e7-7bcb-4ec0-a571-b3180cac77fe is fetched for user d326b7a6842c4419baa3c675cc4e16ca. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[742bf064-4be2-4704-833b-f2108ff1c458]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:53 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD Sep 01 11:32:53 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:53 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1009748105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9311d69b-93f4-43b4-952f-9c7c957a3fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae285f7af06e4700a73fe23db71ef932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:47Z,use_quota=True,user_id='d326b7a6842c4419baa3c675cc4e16ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(338d52a6-ba1e-4a18-b91b-0131acece360),volume_type_id=338d52a6-ba1e-4a18-b91b-0131acece360)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Creating volume 9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:53 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:32:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:53 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 1073741824 Sep 01 11:32:53 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:54 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 1073741824" returned: 0 in 0.762s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:54 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:32:54 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:54 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 0 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:32:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:55 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Attempting download of 9eb052e7-7bcb-4ec0-a571-b3180cac77fe ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'metadata': {}}])) to volume 9311d69b-93f4-43b4-952f-9c7c957a3fb1. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:32:55 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7b82c8-cef4-4cad-ac18-e7ca50cf95a2]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:55 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts Sep 01 11:32:55 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:55 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts" returned: 0 in 0.472s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:55 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts Sep 01 11:32:55 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:56 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts" returned: 1 in 0.487s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_mbpf7zts' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019b7a7-cf8e-4f8b-8e69-c8d3d67067a6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:56 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD Sep 01 11:32:56 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:56 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] 9eb052e7-7bcb-4ec0-a571-b3180cac77fe was qcow2, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:56 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:32:56 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Flow 'volume_create_manager' (1a9aaef8-bff6-40a2-bf3c-55642f3defaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384b00d7-8746-4f82-90fa-0f7349b661bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384b00d7-8746-4f82-90fa-0f7349b661bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1274092808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a6369b-1ea4-4e4b-881c-28a8580ae1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501940b1a7a94bc081ab510343f63efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab8a31a1-3d4c-4c2f-95d4-096aa00acb64,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:32:57Z,use_quota=True,user_id='caee6c13ffb14b789ba3c9b4a5b58366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ee345a-f40f-463e-881b-3c4f750436fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ee345a-f40f-463e-881b-3c4f750436fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13290b6b-a7e7-4324-8245-797ef2c7ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13290b6b-a7e7-4324-8245-797ef2c7ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34a6369b-1ea4-4e4b-881c-28a8580ae1fb', 'volume_name': 'volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb', 'volume_size': 1, 'snapshot_id': 'ab8a31a1-3d4c-4c2f-95d4-096aa00acb64'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb4ff4c-a0bb-42ac-8c4c-78e320e25cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb4ff4c-a0bb-42ac-8c4c-78e320e25cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fdbb95-3486-4fd0-b1d8-25259ef36960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:32:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Volume 34a6369b-1ea4-4e4b-881c-28a8580ae1fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb', 'volume_size': 1, 'snapshot_id': 'ab8a31a1-3d4c-4c2f-95d4-096aa00acb64'} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-quobyte-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Creating volume 34a6369b-1ea4-4e4b-881c-28a8580ae1fb from snapshot ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:32:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-quobyte-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] snapshot: ab8a31a1-3d4c-4c2f-95d4-096aa00acb64, volume: 34a6369b-1ea4-4e4b-881c-28a8580ae1fb, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b6be6-6ea7-4f0a-947d-1b3d2e95ceb2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:57 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 Sep 01 11:32:57 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:57 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" returned: 0 in 0.557s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1bffbb-b14a-439c-b081-b1b361b85de4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[706f9086-2dec-470c-81fa-4b6102d1f623]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:57 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:32:57 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:58 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.483s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:58 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:32:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:58 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb Sep 01 11:32:58 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:58 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 0 in 2.204s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:58 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb052e7-7bcb-4ec0-a571-b3180cac77fe_4ki_c18pdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:32:58 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Converted 112.00 MB image at 50.79 MB/s Sep 01 11:32:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:58 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 1G Sep 01 11:32:58 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:32:59 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 01 11:32:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 1G" returned: 0 in 0.532s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:32:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b78120-2a7e-41ca-bcb1-9629f611de7b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:32:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:32:59 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:32:59 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:00 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 0 in 1.181s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:00 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:33:00 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:01 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 1 in 0.663s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Downloaded image 9eb052e7-7bcb-4ec0-a571-b3180cac77fe ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'metadata': {}}])) to volume 9311d69b-93f4-43b4-952f-9c7c957a3fb1 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Temporary image 9eb052e7-7bcb-4ec0-a571-b3180cac77fe for user d326b7a6842c4419baa3c675cc4e16ca is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Marking volume 9311d69b-93f4-43b4-952f-9c7c957a3fb1 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Copying metadata from image 9eb052e7-7bcb-4ec0-a571-b3180cac77fe to 9311d69b-93f4-43b4-952f-9c7c957a3fb1. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Creating volume glance metadata for volume 9311d69b-93f4-43b4-952f-9c7c957a3fb1 backed by image 9eb052e7-7bcb-4ec0-a571-b3180cac77fe with: {'image_id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'image_name': 'tempest-scenario-img--1905251172', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9e268c-c69d-4ed9-99fc-4680f6ad5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1', 'volume_size': 1, 'image_id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1905251172', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ae285f7af06e4700a73fe23db71ef932', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb052e7-7bcb-4ec0-a571-b3180cac77fe', 'created_at': datetime.datetime(2026, 9, 1, 9, 32, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 32, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb052e7-7bcb-4ec0-a571-b3180cac77fe/file', 'properties': {}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9923621-0085-4748-85fc-02d07cfd9370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Volume volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 (9311d69b-93f4-43b4-952f-9c7c957a3fb1): created successfully Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9923621-0085-4748-85fc-02d07cfd9370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Flow 'volume_create_manager' (8e83bac9-154a-4e78-8227-6c9073fb32ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-00761e11-dbe7-473a-b13a-81fec9d28f84 tempest-TestInstancesWithCinderVolumes-38536295 None] Created volume successfully. Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:04 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:33:04 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:05 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.767s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:33:05 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" returned: 0 in 7.773s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[923dcbc3-71b9-4bca-95cd-0e80560c0c44]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:06 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:33:06 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:06 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.749s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:06 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:33:06 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Converted 1024.00 MB image at 131.72 MB/s Sep 01 11:33:06 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb is being set with open permissions: ugo+rw Sep 01 11:33:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:06 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb Sep 01 11:33:06 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:07 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" released by "_copy_volume_from_snapshot" :: held 10.062s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" released by "_create_volume_from_snapshot" :: held 10.113s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.137s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fdbb95-3486-4fd0-b1d8-25259ef36960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb', 'volume_size': 1, 'snapshot_id': 'ab8a31a1-3d4c-4c2f-95d4-096aa00acb64'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed3762-54e7-45f7-995c-dfa118cdddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:07 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Volume volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb (34a6369b-1ea4-4e4b-881c-28a8580ae1fb): created successfully Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed3762-54e7-45f7-995c-dfa118cdddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Flow 'volume_create_manager' (1a9aaef8-bff6-40a2-bf3c-55642f3defaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a565d61f-255f-44aa-b67a-a9a88c759778 tempest-TestStampPattern-930150698 None] Created volume successfully. Sep 01 11:33:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[873c85c4-216e-46e6-939c-479bc58ea558]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:12 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:33:12 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:13 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 0 in 0.533s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:13 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:33:13 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:13 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 1 in 0.524s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:33:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.154s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15324445-1413-4dc8-9801-f8fad89d54e8', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:33:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-cf3ba13c-d795-4488-8f9d-4a0e1cb86306 req-db4d88e1-67ec-4317-9f45-0cc82cded49d tempest-TestInstancesWithCinderVolumes-38536295 None] attachment_update completed successfully. Sep 01 11:33:23 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=24,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:33:23 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=34,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Flow 'volume_create_manager' (960efe2a-a2e8-4ea6-b644-c8781ee4deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f968c5a-83a0-4358-a214-da6ad6921fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f968c5a-83a0-4358-a214-da6ad6921fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-344369120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c461738f-b5df-4787-9e41-71d798f6a1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3897264626847349f3cc2eeeafebd8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:33:43Z,use_quota=True,user_id='53f2f514a66148148b395c1d3312719f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e77d9b-5b14-455e-b755-31e1885af311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e77d9b-5b14-455e-b755-31e1885af311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e0ab16-f863-49ea-9e69-6dbda002075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e0ab16-f863-49ea-9e69-6dbda002075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c461738f-b5df-4787-9e41-71d798f6a1a8', 'volume_name': 'volume-c461738f-b5df-4787-9e41-71d798f6a1a8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93cba03-f29e-468c-adbf-9e6d2f125625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93cba03-f29e-468c-adbf-9e6d2f125625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271aaf8f-1f8e-40e1-812c-a2bb895abd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Volume c461738f-b5df-4787-9e41-71d798f6a1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c461738f-b5df-4787-9e41-71d798f6a1a8', 'volume_size': 1} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-344369120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c461738f-b5df-4787-9e41-71d798f6a1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3897264626847349f3cc2eeeafebd8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:33:43Z,use_quota=True,user_id='53f2f514a66148148b395c1d3312719f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Creating volume c461738f-b5df-4787-9e41-71d798f6a1a8 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:33:43 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:43 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 1073741824 Sep 01 11:33:43 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:43 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 1073741824" returned: 0 in 0.647s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:44 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 Sep 01 11:33:44 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:44 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8" returned: 0 in 0.348s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271aaf8f-1f8e-40e1-812c-a2bb895abd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c461738f-b5df-4787-9e41-71d798f6a1a8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f825cf-220c-4f6c-8243-9e6e5e33b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Volume volume-c461738f-b5df-4787-9e41-71d798f6a1a8 (c461738f-b5df-4787-9e41-71d798f6a1a8): created successfully Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f825cf-220c-4f6c-8243-9e6e5e33b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Flow 'volume_create_manager' (960efe2a-a2e8-4ea6-b644-c8781ee4deec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b39aff5a-bc87-458f-95a4-842a58ffb4eb tempest-TestMinimumBasicScenario-50928440 None] Created volume successfully. Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd117f-7730-406d-8d5a-17ba230f0069]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:45 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb Sep 01 11:33:45 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:45 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" returned: 0 in 0.554s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.585s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aeda988d-b197-4b20-9da0-313bc0df8b45', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:33:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-a43fae00-b883-41ad-8422-eec41424772f req-c6bd6ad8-ae57-4c4a-8712-2f6f056cf5ef tempest-TestStampPattern-930150698 None] attachment_update completed successfully. Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99b81ce-d327-4143-a17a-087a50590497]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:47 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 Sep 01 11:33:47 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:47 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8" returned: 0 in 0.615s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.653s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-c461738f-b5df-4787-9e41-71d798f6a1a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66191bfb-ffde-4078-be34-a7ea65f334fc', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:33:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-190c2e77-84fb-4f7d-8351-999e53e713b6 req-86ab4fd4-adae-4138-92e9-73cf87ee9510 tempest-TestMinimumBasicScenario-50928440 None] attachment_update completed successfully. Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ff205-0bde-4b54-ab9f-f3ab8c90123c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:49 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c Sep 01 11:33:49 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:49 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c" returned: 0 in 0.520s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.569s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7302cf5e-21b6-4b00-873a-ffab41cce37f', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:33:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-77c390ed-109e-4f99-bca2-b42770cc7547 req-f1153b9f-9eb7-4776-b55a-5e383a3a15c7 tempest-TestInstancesWithCinderVolumes-38536295 None] attachment_update completed successfully. Sep 01 11:33:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-25d8e6e0-6c50-4f1e-a076-96708aaacdbf req-13def7be-896e-4e96-aed1-90f6762c4c41 tempest-TestStampPattern-930150698 None] Terminate volume connection completed successfully. Sep 01 11:33:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-25d8e6e0-6c50-4f1e-a076-96708aaacdbf req-13def7be-896e-4e96-aed1-90f6762c4c41 tempest-TestStampPattern-930150698 None] Deleting attachment aeda988d-b197-4b20-9da0-313bc0df8b45. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Flow 'volume_create_manager' (88360f5f-70e3-4d4f-8c42-12b25bc24ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e61eca0-c4da-401e-9ecd-d3623b7d0010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e61eca0-c4da-401e-9ecd-d3623b7d0010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-762170636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb678ffa-aae4-458c-b9da-b7ac435d1784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0085bc12bb60428cbb49d67a93a44038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:33:52Z,use_quota=True,user_id='6a10fc4a9a72471bb3c1f87cf0ba6713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201286b8-4231-49c4-b48b-a01a2f9f41ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201286b8-4231-49c4-b48b-a01a2f9f41ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b172768-c26b-4020-9ab6-4aa07a2fb2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b172768-c26b-4020-9ab6-4aa07a2fb2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb678ffa-aae4-458c-b9da-b7ac435d1784', 'volume_name': 'volume-eb678ffa-aae4-458c-b9da-b7ac435d1784', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570dda43-efba-4dcc-a3b7-6a168e8c64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570dda43-efba-4dcc-a3b7-6a168e8c64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afc6be0-7f52-434b-aadc-17a389ed6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:52 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Volume eb678ffa-aae4-458c-b9da-b7ac435d1784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb678ffa-aae4-458c-b9da-b7ac435d1784', 'volume_size': 1} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-762170636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb678ffa-aae4-458c-b9da-b7ac435d1784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0085bc12bb60428cbb49d67a93a44038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:33:52Z,use_quota=True,user_id='6a10fc4a9a72471bb3c1f87cf0ba6713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Creating volume eb678ffa-aae4-458c-b9da-b7ac435d1784 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:33:52 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:33:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:52 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 1073741824 Sep 01 11:33:52 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:53 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 1073741824" returned: 0 in 1.379s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:53 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 Sep 01 11:33:53 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:54 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784" returned: 0 in 0.512s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.691s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afc6be0-7f52-434b-aadc-17a389ed6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb678ffa-aae4-458c-b9da-b7ac435d1784', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295787de-f42c-49ae-989d-09ccfd2fe222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f863580b-e7e8-4ea8-aa28-650348e6294d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:54 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Volume volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 (eb678ffa-aae4-458c-b9da-b7ac435d1784): created successfully Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295787de-f42c-49ae-989d-09ccfd2fe222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Flow 'volume_create_manager' (88360f5f-70e3-4d4f-8c42-12b25bc24ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:54 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ae306fa2-4dab-4d44-82db-531c8455e59c tempest-VolumeQuotasAdminTestJSON-219875065 None] Created volume successfully. Sep 01 11:33:54 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 Sep 01 11:33:54 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:54 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" returned: 0 in 0.585s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.644s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '862e9c98-91a2-4939-9c98-1ef86caa02ce', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:33:55 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-08faac7e-3648-40ec-8ae3-7793994d2e4a req-7ef9b5dc-2239-4fcd-a29d-4233c13836d9 tempest-TestInstancesWithCinderVolumes-38536295 None] attachment_update completed successfully. Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "cinder-eb678ffa-aae4-458c-b9da-b7ac435d1784-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "cinder-eb678ffa-aae4-458c-b9da-b7ac435d1784-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "cinder-quobyte-eb678ffa-aae4-458c-b9da-b7ac435d1784" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "cinder-quobyte-eb678ffa-aae4-458c-b9da-b7ac435d1784" acquired by "delete_volume" :: waited 0.041s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f41b98-c91b-4343-a233-025cefda770b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:56 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 Sep 01 11:33:56 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-34a6369b-1ea4-4e4b-881c-28a8580ae1fb-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Lock "cinder-34a6369b-1ea4-4e4b-881c-28a8580ae1fb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-quobyte-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f855539-84eb-4cae-8428-62550fc415c0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:56 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784" returned: 0 in 0.764s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:56 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784 Sep 01 11:33:56 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:56 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb Sep 01 11:33:56 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:57 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-eb678ffa-aae4-458c-b9da-b7ac435d1784" returned: 0 in 0.451s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "cinder-quobyte-eb678ffa-aae4-458c-b9da-b7ac435d1784" released by "delete_volume" :: held 1.292s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:33:57 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" returned: 0 in 0.610s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Created reservations ['65f43b6e-c756-434b-937b-552aef78b9ec', '07bf767b-4844-40e8-a371-2ff361252e48', '074088bd-5b02-443d-b334-4a4f10766ce1', 'a751f848-64ba-4241-8156-a40e0abb9f97'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:33:57 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb Sep 01 11:33:57 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:57 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:33:57 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:57 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" returned: 0 in 0.430s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-34a6369b-1ea4-4e4b-881c-28a8580ae1fb" released by "delete_volume" :: held 1.104s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:33:57 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Created reservations ['4c8b86d2-9e3c-4138-8af3-69a263a2fa38', '7a854c2e-cd24-4e00-9096-0444729af887', '60dfd4d7-995e-4857-a09f-4c80a8d1996d', 'b3bbec7d-19ea-42aa-bfc2-a4c9a2b41bed'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.398s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:33:57 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Deleted volume successfully. Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-026d0e64-5653-4d7b-98bc-a78c6be55ec6 tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "cinder-eb678ffa-aae4-458c-b9da-b7ac435d1784-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:57 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:33:57 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:58 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:33:58 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:33:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Deleted volume successfully. Sep 01 11:33:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b98a18eb-fd98-4221-8977-dcf1f08e902e tempest-TestStampPattern-930150698 None] Lock "cinder-34a6369b-1ea4-4e4b-881c-28a8580ae1fb-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Flow 'volume_create_manager' (07b1ffaf-4bbd-4fee-8297-2176facd80f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4c803e-3950-465c-9375-07f9d066d0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4c803e-3950-465c-9375-07f9d066d0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1339222116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74677756-6bc1-455e-b9ee-ef98f4c81948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0085bc12bb60428cbb49d67a93a44038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:33:59Z,use_quota=True,user_id='6a10fc4a9a72471bb3c1f87cf0ba6713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfc6ad0-4fb5-41d6-a057-e24b7ac1c030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfc6ad0-4fb5-41d6-a057-e24b7ac1c030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4812b554-1eda-4965-9267-d71190cb4479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4812b554-1eda-4965-9267-d71190cb4479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74677756-6bc1-455e-b9ee-ef98f4c81948', 'volume_name': 'volume-74677756-6bc1-455e-b9ee-ef98f4c81948', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440832b1-f391-4953-b547-92ecb1afc558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440832b1-f391-4953-b547-92ecb1afc558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f030d799-ed6f-4c74-910f-de8c44c3e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:33:59 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Volume 74677756-6bc1-455e-b9ee-ef98f4c81948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74677756-6bc1-455e-b9ee-ef98f4c81948', 'volume_size': 1} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1339222116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74677756-6bc1-455e-b9ee-ef98f4c81948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0085bc12bb60428cbb49d67a93a44038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:33:59Z,use_quota=True,user_id='6a10fc4a9a72471bb3c1f87cf0ba6713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Creating volume 74677756-6bc1-455e-b9ee-ef98f4c81948 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:33:59 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:59 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 1073741824 Sep 01 11:33:59 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Lock "cinder-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-quobyte-2b1bffbb-b14a-439c-b081-b1b361b85de4" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-2b1bffbb-b14a-439c-b081-b1b361b85de4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-quobyte-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Deleting offline snapshot ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 of volume 2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] snapshot_file for this snap is: volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1ffca-f8a6-493d-b46a-71e72b989506]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:33:59 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 Sep 01 11:33:59 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:33:59 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 01 11:33:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 1073741824" returned: 0 in 0.748s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:00 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 Sep 01 11:34:00 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:00 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" returned: 0 in 0.644s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1bffbb-b14a-439c-b081-b1b361b85de4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10d1c57-d23a-49ee-8d8b-3631f86d3dd4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:00 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:34:00 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:00 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948" returned: 0 in 0.412s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f030d799-ed6f-4c74-910f-de8c44c3e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74677756-6bc1-455e-b9ee-ef98f4c81948', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75403bd3-88ac-4551-8139-18a6d95921a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:00 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Volume volume-74677756-6bc1-455e-b9ee-ef98f4c81948 (74677756-6bc1-455e-b9ee-ef98f4c81948): created successfully Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75403bd3-88ac-4551-8139-18a6d95921a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Flow 'volume_create_manager' (07b1ffaf-4bbd-4fee-8297-2176facd80f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:00 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f568bead-a54d-4b51-9d03-f58432677adf tempest-VolumeQuotasAdminTestJSON-219875065 None] Created volume successfully. Sep 01 11:34:00 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.584s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:00 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 Sep 01 11:34:00 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:01 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" returned: 0 in 0.642s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:01 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64 Sep 01 11:34:01 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-ce9781d4-089f-464a-ac30-de029000914e req-9dac3e0f-8ae1-42e4-9e6d-8289e84fff94 tempest-TestInstancesWithCinderVolumes-38536295 None] Terminate volume connection completed successfully. Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-ce9781d4-089f-464a-ac30-de029000914e req-9dac3e0f-8ae1-42e4-9e6d-8289e84fff94 tempest-TestInstancesWithCinderVolumes-38536295 None] Deleting attachment 7302cf5e-21b6-4b00-873a-ffab41cce37f. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:34:01 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4.ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" returned: 0 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64" released by "_delete_snapshot" :: held 2.452s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-2b1bffbb-b14a-439c-b081-b1b361b85de4" released by "delete_snapshot" :: held 2.483s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:01 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Created reservations ['7dea1bc4-74e8-4d2a-a7de-ebef557a08f0', '8a966be3-80d7-4a50-bd49-d0045de7b8b9', '520beed4-5051-40d9-80f1-28c531acae7e', 'cc9674eb-f91f-48fb-a1a8-9a05e8a4d010'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Delete snapshot completed successfully. Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9857a8bd-a79b-4452-8d7f-adc24132b975 tempest-TestStampPattern-930150698 None] Lock "cinder-ab8a31a1-3d4c-4c2f-95d4-096aa00acb64-delete_snapshot" released by "delete_snapshot" :: held 2.692s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ba9b2dc6-d34e-47ae-b86d-a455ecb6e650 tempest-VolumeQuotasAdminTestJSON-524836804 None] Transfer volume completed successfully. Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "cinder-0c7d7378-61ec-4826-b90e-2a94e0aed01c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-0c7d7378-61ec-4826-b90e-2a94e0aed01c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "cinder-quobyte-0c7d7378-61ec-4826-b90e-2a94e0aed01c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-quobyte-0c7d7378-61ec-4826-b90e-2a94e0aed01c" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f216a5-5237-4120-9347-ca80504bb70b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Acquiring lock "cinder-74677756-6bc1-455e-b9ee-ef98f4c81948-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Lock "cinder-74677756-6bc1-455e-b9ee-ef98f4c81948-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Acquiring lock "cinder-quobyte-74677756-6bc1-455e-b9ee-ef98f4c81948" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Lock "cinder-quobyte-74677756-6bc1-455e-b9ee-ef98f4c81948" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:02 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c Sep 01 11:34:02 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ec4bc-37b5-4174-a6aa-38cb8b4932dc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:03 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 Sep 01 11:34:03 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:03 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c" returned: 0 in 0.490s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:03 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c Sep 01 11:34:03 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:03 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:03 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948 Sep 01 11:34:03 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:03 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c7d7378-61ec-4826-b90e-2a94e0aed01c" returned: 0 in 0.373s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-quobyte-0c7d7378-61ec-4826-b90e-2a94e0aed01c" released by "delete_volume" :: held 0.930s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:03 devstack cinder-volume[87144]: WARNING cinder.quota [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-505993157-766535011 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-505993157-766535011, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:34:03 devstack cinder-volume[87144]: WARNING cinder.quota [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-505993157-766535011 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-505993157-766535011, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Created reservations ['1ea142ea-a782-4a0d-bf88-29f124718510', '4e7ffc4a-5243-47ba-82ac-0399466848ba', 'c61ed894-a4cf-4fb2-8b09-c78a82f6cd4f', '0fe0d2f2-750e-4acb-94d6-8d7127db37fb'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:04 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:04 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:04 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-74677756-6bc1-455e-b9ee-ef98f4c81948" returned: 0 in 0.773s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Lock "cinder-quobyte-74677756-6bc1-455e-b9ee-ef98f4c81948" released by "delete_volume" :: held 1.284s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Created reservations ['3b9ac618-0322-4def-9cba-09137003e456', 'c6f5916c-b28d-40f9-bd4d-03f518541788', '7d186156-b576-46c3-bf87-7c5ec8b0bd37', 'b36d4210-77c9-466c-8b19-6c025423e38f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:04 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:04 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:04 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:04 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:04 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.764s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Deleted volume successfully. Sep 01 11:34:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a3a6bcd7-e955-4948-a8bf-be97fb272495 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-0c7d7378-61ec-4826-b90e-2a94e0aed01c-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:05 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.624s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Deleted volume successfully. Sep 01 11:34:05 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0c8b1611-ca98-49c1-9426-480aa4071651 tempest-VolumeQuotasAdminTestJSON-364255590 None] Lock "cinder-74677756-6bc1-455e-b9ee-ef98f4c81948-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.515s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:34:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-2b1bffbb-b14a-439c-b081-b1b361b85de4-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Lock "cinder-2b1bffbb-b14a-439c-b081-b1b361b85de4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Acquiring lock "cinder-quobyte-2b1bffbb-b14a-439c-b081-b1b361b85de4" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-2b1bffbb-b14a-439c-b081-b1b361b85de4" acquired by "delete_volume" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6b686c-3b3e-4046-a6e6-191d37d45161]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:07 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:34:07 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-52e975c3-6455-4bda-ac85-eca0a7c37213 req-57d975ef-9890-4fea-b994-7947a3a975f8 tempest-TestInstancesWithCinderVolumes-38536295 None] Terminate volume connection completed successfully. Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-52e975c3-6455-4bda-ac85-eca0a7c37213 req-57d975ef-9890-4fea-b994-7947a3a975f8 tempest-TestInstancesWithCinderVolumes-38536295 None] Deleting attachment 862e9c98-91a2-4939-9c98-1ef86caa02ce. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:34:07 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.435s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:07 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4 Sep 01 11:34:07 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:08 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2b1bffbb-b14a-439c-b081-b1b361b85de4" returned: 0 in 0.265s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Lock "cinder-quobyte-2b1bffbb-b14a-439c-b081-b1b361b85de4" released by "delete_volume" :: held 0.793s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Created reservations ['f587dd95-cfac-4aa7-b245-329ea8c40f6b', '63e0f3c5-2cd7-42a9-a3f5-78f7ed3a9ccb', 'b067a504-c0a3-46ba-817a-b75c5e6e99e1', '662d60aa-f966-4e03-9414-7cc4af970f6b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "cinder-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:08 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:08 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "cinder-quobyte-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-quobyte-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ab46d-836e-4862-84ed-ec02b149def3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:08 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Deleted volume successfully. Sep 01 11:34:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5ff54a4f-760d-4f9a-a2e2-744b4fb3910b tempest-TestStampPattern-930150698 None] Lock "cinder-2b1bffbb-b14a-439c-b081-b1b361b85de4-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:08 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 Sep 01 11:34:08 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:09 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" returned: 0 in 0.488s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:09 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440 Sep 01 11:34:09 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:09 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-quobyte-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440" released by "delete_volume" :: held 0.860s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:09 devstack cinder-volume[87144]: WARNING cinder.quota [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290936123-1785529415 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290936123-1785529415, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:34:09 devstack cinder-volume[87144]: WARNING cinder.quota [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290936123-1785529415 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290936123-1785529415, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Created reservations ['52f59386-47aa-4fb2-8c63-d892985cce78', 'a8e8e169-c868-4048-b51c-a41e90145089', 'fd368928-e4ed-45ba-b013-4b4cc19e9266', '804a9bfb-a44f-4e24-832f-60a59a3714c2'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:09 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:09 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:09 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.367s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:09 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Deleted volume successfully. Sep 01 11:34:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-78d46f8e-8e0b-4a87-a0fe-e41efe347094 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-be3c9f22-5e70-4ea5-84f7-c3ad6f4b1440-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-2c2c5cba-e49c-4404-8976-87c9956d29f8 req-a8147f87-ce0c-40d4-bfe2-c6002f3b9291 tempest-TestInstancesWithCinderVolumes-38536295 None] Terminate volume connection completed successfully. Sep 01 11:34:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-2c2c5cba-e49c-4404-8976-87c9956d29f8 req-a8147f87-ce0c-40d4-bfe2-c6002f3b9291 tempest-TestInstancesWithCinderVolumes-38536295 None] Deleting attachment 15324445-1413-4dc8-9801-f8fad89d54e8. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Flow 'volume_create_manager' (53f4d863-e8e4-4bb8-80bc-d6304b837260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa0d448-51f8-462b-a684-c54217f1b85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa0d448-51f8-462b-a684-c54217f1b85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1796105529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e895627-b46a-4453-922c-3b703aad59aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d193a6005ac4ceebd4132de24b39e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:17Z,use_quota=True,user_id='40019d20d5d34dd1898b39b4bd26963b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dc5a2e-1141-4ec8-a329-47816e318f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dc5a2e-1141-4ec8-a329-47816e318f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc504fa-daa2-4515-8998-85fef429c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc504fa-daa2-4515-8998-85fef429c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e895627-b46a-4453-922c-3b703aad59aa', 'volume_name': 'volume-8e895627-b46a-4453-922c-3b703aad59aa', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198fe232-3efc-4cd1-a23b-6afd2f7033aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198fe232-3efc-4cd1-a23b-6afd2f7033aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fe3c91-f1ee-419f-8919-6d2e30564e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Volume 8e895627-b46a-4453-922c-3b703aad59aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e895627-b46a-4453-922c-3b703aad59aa', 'volume_size': 1} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1796105529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e895627-b46a-4453-922c-3b703aad59aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d193a6005ac4ceebd4132de24b39e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:17Z,use_quota=True,user_id='40019d20d5d34dd1898b39b4bd26963b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Creating volume 8e895627-b46a-4453-922c-3b703aad59aa {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:34:17 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "cinder-9311d69b-93f4-43b4-952f-9c7c957a3fb1-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-9311d69b-93f4-43b4-952f-9c7c957a3fb1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:17 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa 1073741824 Sep 01 11:34:17 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "cinder-quobyte-9311d69b-93f4-43b4-952f-9c7c957a3fb1" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-quobyte-9311d69b-93f4-43b4-952f-9c7c957a3fb1" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3ee5e9-cac7-4a22-bf26-70bce8ee8f70]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:17 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:34:17 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:17 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa 1073741824" returned: 0 in 0.729s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:17 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 0 in 0.563s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:17 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa Sep 01 11:34:17 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:17 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:34:17 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:18 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:18 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa" returned: 0 in 0.381s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 1 in 0.461s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fe3c91-f1ee-419f-8919-6d2e30564e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e895627-b46a-4453-922c-3b703aad59aa', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:18 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1 Sep 01 11:34:18 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e318c43-4f55-4a5d-89ee-e2388529c70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Volume volume-8e895627-b46a-4453-922c-3b703aad59aa (8e895627-b46a-4453-922c-3b703aad59aa): created successfully Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e318c43-4f55-4a5d-89ee-e2388529c70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Flow 'volume_create_manager' (53f4d863-e8e4-4bb8-80bc-d6304b837260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ff701726-cabe-492d-b095-82de308a4048 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Created volume successfully. Sep 01 11:34:18 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9311d69b-93f4-43b4-952f-9c7c957a3fb1" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-quobyte-9311d69b-93f4-43b4-952f-9c7c957a3fb1" released by "delete_volume" :: held 1.384s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:18 devstack cinder-volume[87144]: WARNING cinder.quota [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707721335-1124672970 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707721335-1124672970, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:34:18 devstack cinder-volume[87144]: WARNING cinder.quota [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707721335-1124672970 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707721335-1124672970, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Created reservations ['9aaa2dfb-ca54-43c5-b7b1-85ffc2fd6549', 'c11da64b-acdd-4a1a-9072-a22d8cf796e0', '79f931c9-98b8-4169-887d-d82990e590c4', 'f5682336-2e1a-4fe1-bfa2-82ea6064d3f7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:18 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:18 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:19 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:19 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Deleted volume successfully. Sep 01 11:34:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f9141fa-cc26-41bf-95fb-998473268ef5 tempest-TestInstancesWithCinderVolumes-38536295 None] Lock "cinder-9311d69b-93f4-43b4-952f-9c7c957a3fb1-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Acquiring lock "cinder-8e895627-b46a-4453-922c-3b703aad59aa-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "cinder-8e895627-b46a-4453-922c-3b703aad59aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Acquiring lock "cinder-quobyte-8e895627-b46a-4453-922c-3b703aad59aa" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "cinder-quobyte-8e895627-b46a-4453-922c-3b703aad59aa" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1084bc55-785d-47c4-82fb-b2df2e7ff4ee]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:20 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa Sep 01 11:34:20 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:20 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa" returned: 0 in 0.402s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:20 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa Sep 01 11:34:20 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:21 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8e895627-b46a-4453-922c-3b703aad59aa" returned: 0 in 0.457s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "cinder-quobyte-8e895627-b46a-4453-922c-3b703aad59aa" released by "delete_volume" :: held 0.930s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Created reservations ['8a670c07-4ab6-4238-b58b-c472067cbbbc', 'ab7208ce-7715-4437-8941-28b7f9cf0ce7', 'aac255bd-06ff-4cd0-b1ab-f4815e7b33e4', '61f277e2-8c01-4889-a74b-995b5d7b5605'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:21 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:21 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:22 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.490s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:22 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Deleted volume successfully. Sep 01 11:34:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a9fa5658-619a-4fd5-8cc0-79b96850a4f5 tempest-VolumeQuotasNegativeTestJSON-639119196 None] Lock "cinder-8e895627-b46a-4453-922c-3b703aad59aa-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Flow 'volume_create_manager' (146b72fe-abb4-49cf-a115-a9c395b92738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c824166-f81d-4aaa-b7e2-8e514f57d992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c824166-f81d-4aaa-b7e2-8e514f57d992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2088259966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5165a5-5217-45e5-b461-72145c0ab42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d963d44d4a74dbea66341c240dd3cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:28Z,use_quota=True,user_id='899e188483474469b029b549b93bd144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae9e640-5999-47a6-88df-333316287b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae9e640-5999-47a6-88df-333316287b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb575359-f06d-46e9-9e1a-a494e7262260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb575359-f06d-46e9-9e1a-a494e7262260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5165a5-5217-45e5-b461-72145c0ab42c', 'volume_name': 'volume-9f5165a5-5217-45e5-b461-72145c0ab42c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c7ec0b-08fc-43a5-8b00-ad23808f6db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c7ec0b-08fc-43a5-8b00-ad23808f6db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd2b0f3-e31e-4bb6-9893-e0fa77c7c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:28 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Volume 9f5165a5-5217-45e5-b461-72145c0ab42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5165a5-5217-45e5-b461-72145c0ab42c', 'volume_size': 1} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2088259966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5165a5-5217-45e5-b461-72145c0ab42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d963d44d4a74dbea66341c240dd3cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:28Z,use_quota=True,user_id='899e188483474469b029b549b93bd144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Creating volume 9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:34:28 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:28 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c 1073741824 Sep 01 11:34:28 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:28 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c 1073741824" returned: 0 in 0.484s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:28 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:28 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:28 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.302s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:34:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd2b0f3-e31e-4bb6-9893-e0fa77c7c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5165a5-5217-45e5-b461-72145c0ab42c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fecd44-f62a-49eb-85a2-2b5fd457dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:29 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Volume volume-9f5165a5-5217-45e5-b461-72145c0ab42c (9f5165a5-5217-45e5-b461-72145c0ab42c): created successfully Sep 01 11:34:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fecd44-f62a-49eb-85a2-2b5fd457dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Flow 'volume_create_manager' (146b72fe-abb4-49cf-a115-a9c395b92738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bc20202a-be88-404d-82aa-8345ac3c39ed tempest-VolumeDependencyTests-235228848 None] Created volume successfully. Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Creating offline snapshot b1709eb3-6ad4-4e7d-81a7-07aacd693e48 of volume 9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e812ec7-1a9b-4419-8ae1-ece42d474f51]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:30 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:30 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:30 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.493s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:31 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 1G Sep 01 11:34:31 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:31 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 1G" returned: 0 in 0.684s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5165a5-5217-45e5-b461-72145c0ab42c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:31 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5165a5-5217-45e5-b461-72145c0ab42c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 Sep 01 11:34:31 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:32 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5165a5-5217-45e5-b461-72145c0ab42c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48" returned: 0 in 0.362s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:32 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 is being set with open permissions: ugo+rw Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:32 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 Sep 01 11:34:32 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:32 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:32 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info Sep 01 11:34:32 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:32 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info" returned: 0 in 0.308s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:32 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info is being set with open permissions: ugo+rw Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:32 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info Sep 01 11:34:32 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:32 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.info" returned: 0 in 0.282s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-20cb8aa1-ddd0-41f5-9f55-ea388ab5fb25 tempest-VolumeDependencyTests-235228848 None] Create snapshot completed successfully Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=86,cinder:UPDATE=81,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=87,cinder:UPDATE=105,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Flow 'volume_create_manager' (b5dd2bec-1276-4616-b4fd-a1d2894cf85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8323df3-de1b-42e0-b5f8-d2a7bce8d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8323df3-de1b-42e0-b5f8-d2a7bce8d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1499604685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb08743a-4ad7-411e-b523-16a53c549102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d963d44d4a74dbea66341c240dd3cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1709eb3-6ad4-4e7d-81a7-07aacd693e48,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:34Z,use_quota=True,user_id='899e188483474469b029b549b93bd144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f158a7-3e35-434e-9e95-dc529a5aad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f158a7-3e35-434e-9e95-dc529a5aad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212af39a-6b58-46d3-9740-8547b9058f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212af39a-6b58-46d3-9740-8547b9058f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb08743a-4ad7-411e-b523-16a53c549102', 'volume_name': 'volume-cb08743a-4ad7-411e-b523-16a53c549102', 'volume_size': 1, 'snapshot_id': 'b1709eb3-6ad4-4e7d-81a7-07aacd693e48'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2404eb10-403d-4bea-8b20-05cdc35a838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2404eb10-403d-4bea-8b20-05cdc35a838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606f1b62-87af-43d6-83d0-1bef8331b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:34 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Volume cb08743a-4ad7-411e-b523-16a53c549102: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb08743a-4ad7-411e-b523-16a53c549102', 'volume_size': 1, 'snapshot_id': 'b1709eb3-6ad4-4e7d-81a7-07aacd693e48'} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-quobyte-b1709eb3-6ad4-4e7d-81a7-07aacd693e48-cb08743a-4ad7-411e-b523-16a53c549102" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-b1709eb3-6ad4-4e7d-81a7-07aacd693e48-cb08743a-4ad7-411e-b523-16a53c549102" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Creating volume cb08743a-4ad7-411e-b523-16a53c549102 from snapshot b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-quobyte-cb08743a-4ad7-411e-b523-16a53c549102" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-cb08743a-4ad7-411e-b523-16a53c549102" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] snapshot: b1709eb3-6ad4-4e7d-81a7-07aacd693e48, volume: cb08743a-4ad7-411e-b523-16a53c549102, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d67f8a4-2164-4741-9bcb-c660a736e350]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:34 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 Sep 01 11:34:34 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:35 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48" returned: 0 in 0.605s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5165a5-5217-45e5-b461-72145c0ab42c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2914a1c3-0a1f-4823-9784-26747db5e488]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:35 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:35 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:35 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.447s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:34:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:35 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 Sep 01 11:34:35 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-a5614606-236c-4956-a9d9-283fc52e7d65 req-ee636fa3-cd2d-4d4a-852e-77a1b6771110 tempest-TestMinimumBasicScenario-50928440 None] Terminate volume connection completed successfully. Sep 01 11:34:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-a5614606-236c-4956-a9d9-283fc52e7d65 req-ee636fa3-cd2d-4d4a-852e-77a1b6771110 tempest-TestMinimumBasicScenario-50928440 None] Deleting attachment 66191bfb-ffde-4078-be34-a7ea65f334fc. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:34:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Acquiring lock "cinder-c461738f-b5df-4787-9e41-71d798f6a1a8-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Lock "cinder-c461738f-b5df-4787-9e41-71d798f6a1a8-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Acquiring lock "cinder-quobyte-c461738f-b5df-4787-9e41-71d798f6a1a8" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Lock "cinder-quobyte-c461738f-b5df-4787-9e41-71d798f6a1a8" acquired by "delete_volume" :: waited 0.040s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:39 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[27efe670-2608-42d7-b289-0125b20338b5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:40 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 Sep 01 11:34:40 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:40 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8" returned: 0 in 1.036s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:41 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8 Sep 01 11:34:41 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:42 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c461738f-b5df-4787-9e41-71d798f6a1a8" returned: 0 in 1.120s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Lock "cinder-quobyte-c461738f-b5df-4787-9e41-71d798f6a1a8" released by "delete_volume" :: held 2.297s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Created reservations ['e2ae46ef-febd-4cb5-a5f2-bb61e85d35f6', '208c1ade-1de2-44f6-b36f-10d52dca4798', '423dde6b-fb0d-43dc-b877-5d60c4dc8fdd', 'f8add7c3-f096-4af2-aed6-dce3724c9ffb'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:42 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:42 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:42 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102" returned: 0 in 7.069s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5c8401-9da9-4c79-a39b-7f866b0d3f11]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:43 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.530s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Deleted volume successfully. Sep 01 11:34:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c1147d2-432e-4e13-bec9-ac31dabaa0ad tempest-TestMinimumBasicScenario-50928440 None] Lock "cinder-c461738f-b5df-4787-9e41-71d798f6a1a8-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:43 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:43 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:43 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.909s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:43 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:34:43 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Converted 1024.00 MB image at 144.79 MB/s Sep 01 11:34:43 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 is being set with open permissions: ugo+rw Sep 01 11:34:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:43 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 Sep 01 11:34:43 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:44 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102" returned: 0 in 0.493s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-cb08743a-4ad7-411e-b523-16a53c549102" released by "_copy_volume_from_snapshot" :: held 9.688s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-b1709eb3-6ad4-4e7d-81a7-07aacd693e48-cb08743a-4ad7-411e-b523-16a53c549102" released by "_create_volume_from_snapshot" :: held 9.749s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.785s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606f1b62-87af-43d6-83d0-1bef8331b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb08743a-4ad7-411e-b523-16a53c549102', 'volume_size': 1, 'snapshot_id': 'b1709eb3-6ad4-4e7d-81a7-07aacd693e48'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eaae6c-14df-4fe2-b82f-a69fa22c52df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Volume volume-cb08743a-4ad7-411e-b523-16a53c549102 (cb08743a-4ad7-411e-b523-16a53c549102): created successfully Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eaae6c-14df-4fe2-b82f-a69fa22c52df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Flow 'volume_create_manager' (b5dd2bec-1276-4616-b4fd-a1d2894cf85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-75cc38ca-501d-4ccb-957f-8d0d84baeaf5 tempest-VolumeDependencyTests-235228848 None] Created volume successfully. Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-b1709eb3-6ad4-4e7d-81a7-07aacd693e48-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-b1709eb3-6ad4-4e7d-81a7-07aacd693e48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-quobyte-9f5165a5-5217-45e5-b461-72145c0ab42c" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-9f5165a5-5217-45e5-b461-72145c0ab42c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-quobyte-b1709eb3-6ad4-4e7d-81a7-07aacd693e48" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-b1709eb3-6ad4-4e7d-81a7-07aacd693e48" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Deleting offline snapshot b1709eb3-6ad4-4e7d-81a7-07aacd693e48 of volume 9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] snapshot_file for this snap is: volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[61664c04-7f6b-494f-b493-de7baea17d22]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Flow 'volume_create_manager' (52e9d2b4-0594-4821-8d26-d6cde0e3051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5489f591-acb8-4e91-b2e6-72ca86efe1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5489f591-acb8-4e91-b2e6-72ca86efe1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1717649991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360bcd80-af12-406b-9b0e-c54196669fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f787141bda244fc4b27001a39af1eee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:45Z,use_quota=True,user_id='ec22f50f30514bec80b66680275a1370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a386c24d-cb34-4c10-b6ec-b54c444ceb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a386c24d-cb34-4c10-b6ec-b54c444ceb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbed611-a12b-48e6-bd0a-8ab2accae448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbed611-a12b-48e6-bd0a-8ab2accae448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360bcd80-af12-406b-9b0e-c54196669fc9', 'volume_name': 'volume-360bcd80-af12-406b-9b0e-c54196669fc9', 'volume_size': 2}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceb8e13-c475-43a0-893a-ae5030d47fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceb8e13-c475-43a0-893a-ae5030d47fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:45 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 Sep 01 11:34:45 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5029e66-9bab-45cc-892b-076c6c7ef393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Volume 360bcd80-af12-406b-9b0e-c54196669fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360bcd80-af12-406b-9b0e-c54196669fc9', 'volume_size': 2} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1717649991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360bcd80-af12-406b-9b0e-c54196669fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f787141bda244fc4b27001a39af1eee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:45Z,use_quota=True,user_id='ec22f50f30514bec80b66680275a1370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Creating volume 360bcd80-af12-406b-9b0e-c54196669fc9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:34:45 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 2147483648 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:45 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 2147483648 Sep 01 11:34:45 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:45 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48" returned: 0 in 0.440s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5165a5-5217-45e5-b461-72145c0ab42c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac715cbb-eedf-4f05-9720-36e0225dc18c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:45 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:45 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:45 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 2147483648" returned: 0 in 0.586s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:45 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 Sep 01 11:34:45 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:46 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.517s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:46 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 Sep 01 11:34:46 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:46 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9" returned: 0 in 0.394s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5029e66-9bab-45cc-892b-076c6c7ef393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360bcd80-af12-406b-9b0e-c54196669fc9', 'volume_size': 2}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386bd33b-6840-4e53-a52f-c88de006eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:46 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Volume volume-360bcd80-af12-406b-9b0e-c54196669fc9 (360bcd80-af12-406b-9b0e-c54196669fc9): created successfully Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386bd33b-6840-4e53-a52f-c88de006eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Flow 'volume_create_manager' (52e9d2b4-0594-4821-8d26-d6cde0e3051e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bd9bfed4-4ace-46f2-a2c7-d1b042a96f09 tempest-VolumesCloneNegativeTest-1951015405 None] Created volume successfully. Sep 01 11:34:46 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48" returned: 0 in 0.424s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:46 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48 Sep 01 11:34:46 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:46 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c.b1709eb3-6ad4-4e7d-81a7-07aacd693e48" returned: 0 in 0.261s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-b1709eb3-6ad4-4e7d-81a7-07aacd693e48" released by "_delete_snapshot" :: held 1.777s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-9f5165a5-5217-45e5-b461-72145c0ab42c" released by "delete_snapshot" :: held 1.806s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:46 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Created reservations ['eb88b3b2-5954-490d-8c55-8a73963ac0e8', '2a84966b-fd22-4458-8c62-d6450699e9e1', '78bbfa11-928a-4627-803a-2c786e381314', '7c60bee8-fef5-4fe5-8237-5bddcf475f84'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Delete snapshot completed successfully. Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-751a541b-5828-4ab3-9447-5d4cfc313041 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-b1709eb3-6ad4-4e7d-81a7-07aacd693e48-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-9f5165a5-5217-45e5-b461-72145c0ab42c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Lock "cinder-9f5165a5-5217-45e5-b461-72145c0ab42c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-quobyte-9f5165a5-5217-45e5-b461-72145c0ab42c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-9f5165a5-5217-45e5-b461-72145c0ab42c" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de1569-b8f0-4717-a516-31c21e83854c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Acquiring lock "cinder-360bcd80-af12-406b-9b0e-c54196669fc9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "cinder-360bcd80-af12-406b-9b0e-c54196669fc9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Acquiring lock "cinder-quobyte-360bcd80-af12-406b-9b0e-c54196669fc9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "cinder-quobyte-360bcd80-af12-406b-9b0e-c54196669fc9" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b706b3c-a0be-4e74-8327-9918a1c968a7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:47 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:47 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:47 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 Sep 01 11:34:47 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:48 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.613s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:48 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9" returned: 0 in 0.428s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:48 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c Sep 01 11:34:48 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:48 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9 Sep 01 11:34:48 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:48 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9f5165a5-5217-45e5-b461-72145c0ab42c" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-9f5165a5-5217-45e5-b461-72145c0ab42c" released by "delete_volume" :: held 1.031s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Created reservations ['52a651b5-d191-4b3c-b7a7-4101cae6d173', 'f32b4ee7-25db-4be0-bc18-15b7520cbe69', 'a962c1c3-47d9-44f0-8e0c-ee31ec6db830', 'f025ced4-a1c9-4e11-9c7d-ceb78185f094'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:48 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-360bcd80-af12-406b-9b0e-c54196669fc9" returned: 0 in 0.490s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "cinder-quobyte-360bcd80-af12-406b-9b0e-c54196669fc9" released by "delete_volume" :: held 0.972s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:48 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:48 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Created reservations ['98c9e6c2-c594-415d-af29-db8f17ecb4fb', '2dbb1b1a-90ce-4c5d-ac32-ecf2d2b96855', '2dc19370-4561-4308-a3b1-8083c75fa8f5', '62645a48-225b-438c-aa10-db955161b82f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:48 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:48 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:49 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.414s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Deleted volume successfully. Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-53e81642-6452-4d1d-b51d-94af0375e2fa tempest-VolumeDependencyTests-235228848 None] Lock "cinder-9f5165a5-5217-45e5-b461-72145c0ab42c-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:49 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.374s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Deleted volume successfully. Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-617d8d8f-0ead-4910-b91c-b68e99d43484 tempest-VolumesCloneNegativeTest-1951015405 None] Lock "cinder-360bcd80-af12-406b-9b0e-c54196669fc9-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-cb08743a-4ad7-411e-b523-16a53c549102-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-cb08743a-4ad7-411e-b523-16a53c549102-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "cinder-quobyte-cb08743a-4ad7-411e-b523-16a53c549102" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-cb08743a-4ad7-411e-b523-16a53c549102" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[422fb0f6-4073-4b3d-9004-93273f461043]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:49 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 Sep 01 11:34:49 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:50 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102" returned: 0 in 0.456s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:50 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102 Sep 01 11:34:50 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:50 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-cb08743a-4ad7-411e-b523-16a53c549102" returned: 0 in 0.302s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-quobyte-cb08743a-4ad7-411e-b523-16a53c549102" released by "delete_volume" :: held 0.810s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Created reservations ['f2eaed67-9ce0-4baf-84a4-032b1d0a4822', '21bdfd88-1d25-4ebd-a7fb-95975c9f079c', '17a263ee-a80b-404d-a3fb-0de41f376be2', 'b24e1cdc-8c9a-4b5d-81e4-c830fde0680b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:50 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:34:50 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:51 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.374s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:51 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:34:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Deleted volume successfully. Sep 01 11:34:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c2fb4263-456a-43b6-b748-50654261c943 tempest-VolumeDependencyTests-235228848 None] Lock "cinder-cb08743a-4ad7-411e-b523-16a53c549102-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Flow 'volume_create_manager' (cab19842-454a-4f37-ae11-26b047f8688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37d49c9-0dc0-4b91-a1b3-9d5afd420f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37d49c9-0dc0-4b91-a1b3-9d5afd420f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-974454270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae315080-6f55-499c-b2b7-b4307c484313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf0d8662c3a4925a3f86c72633c939c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:56Z,use_quota=True,user_id='040d0f830da74e599027294f920532ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175f6f14-fbc4-4e8c-b7cd-482a19f548ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175f6f14-fbc4-4e8c-b7cd-482a19f548ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d988ef6-64bb-4825-b4d9-98c627b8fea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d988ef6-64bb-4825-b4d9-98c627b8fea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae315080-6f55-499c-b2b7-b4307c484313', 'volume_name': 'volume-ae315080-6f55-499c-b2b7-b4307c484313', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203f1450-429f-4de3-81b2-fe0c36ef0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203f1450-429f-4de3-81b2-fe0c36ef0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04e73c4-e11b-4668-be15-86bb9a3e405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:34:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Volume ae315080-6f55-499c-b2b7-b4307c484313: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae315080-6f55-499c-b2b7-b4307c484313', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 11:34:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Trying to clone ae315080-6f55-499c-b2b7-b4307c484313 from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:34:57 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:34:57 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Image download 20.69 MB at 20.69 MB/s Sep 01 11:34:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8aed00-eb56-4dac-88a7-9983e5063358]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:57 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD Sep 01 11:34:57 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:57 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:57 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b is fetched for user 040d0f830da74e599027294f920532ae. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6daddd-3f5d-4c3d-beb5-4b1f885bb936]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:58 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD Sep 01 11:34:58 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:58 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-974454270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae315080-6f55-499c-b2b7-b4307c484313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf0d8662c3a4925a3f86c72633c939c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:34:56Z,use_quota=True,user_id='040d0f830da74e599027294f920532ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Creating volume ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:34:58 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:58 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 1073741824 Sep 01 11:34:58 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:58 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 1073741824" returned: 0 in 0.526s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:59 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:34:59 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:59 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Attempting download of 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume ae315080-6f55-499c-b2b7-b4307c484313. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b1039c-6d39-450e-a233-c313e07f4d09]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:34:59 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7 Sep 01 11:34:59 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:34:59 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7" returned: 0 in 0.481s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:34:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:00 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7 Sep 01 11:35:00 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:00 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7" returned: 1 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_fw82v1e7' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2859fa-2bb7-4945-876f-e2615c0fcf9f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:00 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD Sep 01 11:35:00 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:00 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b was qcow2, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:00 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:00 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Flow 'volume_create_manager' (931722a7-d669-4f70-b5f3-1da4b8ac5145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1daad9d-9016-4fa6-8a16-18ccfb36cc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1daad9d-9016-4fa6-8a16-18ccfb36cc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502dda1a-6a53-4e13-8c9d-0615202cfc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a08ad6c0ff940859fdb44688854eeea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:01Z,use_quota=True,user_id='8cc8353d5a074f78b82404f524dc5b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a99fa5d-4559-46ee-8f61-6a96b144500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a99fa5d-4559-46ee-8f61-6a96b144500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3942ed72-2c70-4f1e-8356-176831a5d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:00 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3942ed72-2c70-4f1e-8356-176831a5d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '502dda1a-6a53-4e13-8c9d-0615202cfc95', 'volume_name': 'volume-502dda1a-6a53-4e13-8c9d-0615202cfc95', 'volume_size': 1, 'image_id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd239e05-63bf-4493-993d-edb0abc9316f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2db3a31f680d51051fcc8ef29f73e40e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a08ad6c0ff940859fdb44688854eeea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '728848354533e5353b38cb96f80bb04a827dc59288fed4ef238e7e2d1d0a2830be380bafc8101ec55d8f98f35d090e44b75fd57f3e639b62dc0510d25caa3c68', 'id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'created_at': datetime.datetime(2026, 9, 1, 9, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd239e05-63bf-4493-993d-edb0abc9316f/file', 'properties': {}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6f1b46-1ed0-443c-87fd-173878de839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6f1b46-1ed0-443c-87fd-173878de839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d5a712-e100-41db-ba8d-548af01e9ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Volume 502dda1a-6a53-4e13-8c9d-0615202cfc95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-502dda1a-6a53-4e13-8c9d-0615202cfc95', 'volume_size': 1, 'image_id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd239e05-63bf-4493-993d-edb0abc9316f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2db3a31f680d51051fcc8ef29f73e40e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a08ad6c0ff940859fdb44688854eeea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '728848354533e5353b38cb96f80bb04a827dc59288fed4ef238e7e2d1d0a2830be380bafc8101ec55d8f98f35d090e44b75fd57f3e639b62dc0510d25caa3c68', 'id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'created_at': datetime.datetime(2026, 9, 1, 9, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd239e05-63bf-4493-993d-edb0abc9316f/file', 'properties': {}}, 'image_service': } Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Trying to clone 502dda1a-6a53-4e13-8c9d-0615202cfc95 from image dd239e05-63bf-4493-993d-edb0abc9316f at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd239e05-63bf-4493-993d-edb0abc9316f', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:35:01 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Image download 0.00 MB at 0.00 MB/s Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6578b58c-9eca-4864-8649-2ab7babdb20a]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:01 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD Sep 01 11:35:01 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:02 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:02 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD Sep 01 11:35:02 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:02 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Temporary image dd239e05-63bf-4493-993d-edb0abc9316f is fetched for user 8cc8353d5a074f78b82404f524dc5b8a. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d191707-b476-4a70-bb0b-6aa58792327e]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:02 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD Sep 01 11:35:02 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:03 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:03 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 0 in 2.390s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_5eriwkr1devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:35:03 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Converted 112.00 MB image at 46.80 MB/s Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:03 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 1G Sep 01 11:35:03 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:03 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD Sep 01 11:35:03 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:03 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 1G" returned: 0 in 0.381s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:03 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502dda1a-6a53-4e13-8c9d-0615202cfc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a08ad6c0ff940859fdb44688854eeea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:01Z,use_quota=True,user_id='8cc8353d5a074f78b82404f524dc5b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Creating volume 502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:03 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd46e236-9204-4d3e-8e36-f5f20562f47b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:03 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 1073741824 Sep 01 11:35:03 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:03 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:03 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:04 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 0 in 0.532s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:04 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 1073741824" returned: 0 in 0.616s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:04 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:04 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:04 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:04 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:04 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:04 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:04 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 0 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:04 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 1 in 0.495s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Downloaded image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume ae315080-6f55-499c-b2b7-b4307c484313 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b for user 040d0f830da74e599027294f920532ae is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Marking volume ae315080-6f55-499c-b2b7-b4307c484313 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Copying metadata from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b to ae315080-6f55-499c-b2b7-b4307c484313. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Creating volume glance metadata for volume ae315080-6f55-499c-b2b7-b4307c484313 backed by image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Attempting download of dd239e05-63bf-4493-993d-edb0abc9316f ((None, [{'url': 'file:///opt/stack/data/glance/images/dd239e05-63bf-4493-993d-edb0abc9316f', 'metadata': {}}])) to volume 502dda1a-6a53-4e13-8c9d-0615202cfc95. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e11687-3d52-4699-86b0-0d0741fa6d34]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04e73c4-e11b-4668-be15-86bb9a3e405f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae315080-6f55-499c-b2b7-b4307c484313', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dc2c76-1ea2-4045-bc06-e91ae43b9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:04 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Volume volume-ae315080-6f55-499c-b2b7-b4307c484313 (ae315080-6f55-499c-b2b7-b4307c484313): created successfully Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dc2c76-1ea2-4045-bc06-e91ae43b9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Flow 'volume_create_manager' (cab19842-454a-4f37-ae11-26b047f8688b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:04 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.359s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-983416a0-d95b-450d-9f07-55adf59579ef tempest-VolumesExtendTest-201597005 None] Created volume successfully. Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:35:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:35:05 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb Sep 01 11:35:05 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:05 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb" returned: 0 in 0.432s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:05 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb Sep 01 11:35:05 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:05 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb" returned: 1 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd239e05-63bf-4493-993d-edb0abc9316f_wwjeucdb' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ed26f8-cc17-4a1b-91f9-6d211ac20b98]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:05 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD Sep 01 11:35:05 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:06 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:06 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD Sep 01 11:35:06 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eeb9ae-fa98-43bc-a669-114fd78ca5f7]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:06 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:06 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:06 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] dd239e05-63bf-4493-993d-edb0abc9316f was raw, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:06 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:06 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:06 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 0 in 0.477s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:06 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:06 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:06 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 0 in 0.416s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd239e05-63bf-4493-993d-edb0abc9316f_bftddamsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:35:06 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 11:35:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:06 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 1G Sep 01 11:35:06 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:07 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 1 in 0.571s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 2G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:07 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 1G" returned: 0 in 0.445s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[05123640-2e5e-47dd-ae64-7a056f600272]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 2G" returned: 0 in 0.100s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.209s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-86c6dfca-c9d5-4770-ad3c-19e4bdea0a35 tempest-VolumesExtendTest-201597005 None] Extend volume completed successfully. Sep 01 11:35:07 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:07 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:07 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 0 in 0.452s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:08 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:08 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:08 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 1 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Downloaded image dd239e05-63bf-4493-993d-edb0abc9316f ((None, [{'url': 'file:///opt/stack/data/glance/images/dd239e05-63bf-4493-993d-edb0abc9316f', 'metadata': {}}])) to volume 502dda1a-6a53-4e13-8c9d-0615202cfc95 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Temporary image dd239e05-63bf-4493-993d-edb0abc9316f for user 8cc8353d5a074f78b82404f524dc5b8a is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Marking volume 502dda1a-6a53-4e13-8c9d-0615202cfc95 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Copying metadata from image dd239e05-63bf-4493-993d-edb0abc9316f to 502dda1a-6a53-4e13-8c9d-0615202cfc95. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Creating volume glance metadata for volume 502dda1a-6a53-4e13-8c9d-0615202cfc95 backed by image dd239e05-63bf-4493-993d-edb0abc9316f with: {'image_id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2db3a31f680d51051fcc8ef29f73e40e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d5a712-e100-41db-ba8d-548af01e9ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502dda1a-6a53-4e13-8c9d-0615202cfc95', 'volume_size': 1, 'image_id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd239e05-63bf-4493-993d-edb0abc9316f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2db3a31f680d51051fcc8ef29f73e40e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a08ad6c0ff940859fdb44688854eeea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '728848354533e5353b38cb96f80bb04a827dc59288fed4ef238e7e2d1d0a2830be380bafc8101ec55d8f98f35d090e44b75fd57f3e639b62dc0510d25caa3c68', 'id': 'dd239e05-63bf-4493-993d-edb0abc9316f', 'created_at': datetime.datetime(2026, 9, 1, 9, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd239e05-63bf-4493-993d-edb0abc9316f/file', 'properties': {}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7ec92c-32d9-4dff-abba-03cac7cf5d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Volume volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 (502dda1a-6a53-4e13-8c9d-0615202cfc95): created successfully Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7ec92c-32d9-4dff-abba-03cac7cf5d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Flow 'volume_create_manager' (931722a7-d669-4f70-b5f3-1da4b8ac5145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-deeda23e-3b06-4b67-82e4-f6aeb7449976 tempest-VolumeImageDependencyTests-622095528 None] Created volume successfully. Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-ae315080-6f55-499c-b2b7-b4307c484313-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Lock "cinder-ae315080-6f55-499c-b2b7-b4307c484313-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-quobyte-ae315080-6f55-499c-b2b7-b4307c484313" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-ae315080-6f55-499c-b2b7-b4307c484313" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad259beb-9d6c-4e41-bdf3-7d9a67a2f2f7]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:08 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:08 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:09 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 0 in 0.417s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:09 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:09 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:09 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 1 in 0.488s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Acquiring lock "cinder-502dda1a-6a53-4e13-8c9d-0615202cfc95-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:09 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313 Sep 01 11:35:09 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Lock "cinder-502dda1a-6a53-4e13-8c9d-0615202cfc95-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Acquiring lock "cinder-quobyte-502dda1a-6a53-4e13-8c9d-0615202cfc95" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Lock "cinder-quobyte-502dda1a-6a53-4e13-8c9d-0615202cfc95" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0398760-8f02-403d-93c9-88c75ef8c54b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:10 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:10 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:10 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ae315080-6f55-499c-b2b7-b4307c484313" returned: 0 in 0.429s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-ae315080-6f55-499c-b2b7-b4307c484313" released by "delete_volume" :: held 1.422s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Created reservations ['1c17c304-4dad-4944-8b91-714f9b4d9be9', '8c42d18a-15f3-4f04-9e95-96cc5ee57620', 'ecea1790-bc3f-4665-b02a-4605b3aed2ce', '02063878-5b0d-459c-aca4-5abbafd40500'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Flow 'volume_create_manager' (74ddd0dd-cc16-4e8f-8ab3-2f56df07da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0daacd-6b92-4d49-87a4-a439b1eb5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0daacd-6b92-4d49-87a4-a439b1eb5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f58695-bd68-4dc5-9cdb-35c005f5a621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7c860a76d24ddd8f0680079ece0880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:10Z,use_quota=True,user_id='c1bc1b5e607643eba92446768ce2d413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ff2f9fc-5c4c-4e5c-bcb4-84a3ef7e3da8),volume_type_id=1ff2f9fc-5c4c-4e5c-bcb4-84a3ef7e3da8)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544667d5-a18c-42e7-b615-ea9d7cd6316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544667d5-a18c-42e7-b615-ea9d7cd6316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097701a7-2430-4b5e-915d-a4d1b063b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:10 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 0 in 0.518s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:10 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:10 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:10 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:10 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097701a7-2430-4b5e-915d-a4d1b063b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47f58695-bd68-4dc5-9cdb-35c005f5a621', 'volume_name': 'volume-47f58695-bd68-4dc5-9cdb-35c005f5a621', 'volume_size': 1, 'image_id': '0e29cca5-2534-45a9-8816-654501894681', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e29cca5-2534-45a9-8816-654501894681', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da0618c00382fd1d21db5bbf26b7abb6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d7c860a76d24ddd8f0680079ece0880', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35e5cc7385130ceb0e3ddc205d5002f27bbfca4c1c9e1ecb8d45d7aafd4bce16c48cf7e24f402472ddd4b34f66b9fa0d938a7814aa6454736087c44bf1fd0220', 'id': '0e29cca5-2534-45a9-8816-654501894681', 'created_at': datetime.datetime(2026, 9, 1, 9, 35, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 35, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e29cca5-2534-45a9-8816-654501894681/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35c2ad8-bc06-4abb-acef-ae8d7bb37654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e35c2ad8-bc06-4abb-acef-ae8d7bb37654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ef40fe-e6cf-4f38-a655-2fc428782af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:10 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Volume 47f58695-bd68-4dc5-9cdb-35c005f5a621: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47f58695-bd68-4dc5-9cdb-35c005f5a621', 'volume_size': 1, 'image_id': '0e29cca5-2534-45a9-8816-654501894681', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e29cca5-2534-45a9-8816-654501894681', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da0618c00382fd1d21db5bbf26b7abb6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d7c860a76d24ddd8f0680079ece0880', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35e5cc7385130ceb0e3ddc205d5002f27bbfca4c1c9e1ecb8d45d7aafd4bce16c48cf7e24f402472ddd4b34f66b9fa0d938a7814aa6454736087c44bf1fd0220', 'id': '0e29cca5-2534-45a9-8816-654501894681', 'created_at': datetime.datetime(2026, 9, 1, 9, 35, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 35, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e29cca5-2534-45a9-8816-654501894681/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Trying to clone 47f58695-bd68-4dc5-9cdb-35c005f5a621 from image 0e29cca5-2534-45a9-8816-654501894681 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e29cca5-2534-45a9-8816-654501894681', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:35:10 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.335s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Deleted volume successfully. Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:35:10 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Image download 0.00 MB at 0.00 MB/s Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ff8bf675-f632-470b-bc93-f13952ceaec0 tempest-VolumesExtendTest-201597005 None] Lock "cinder-ae315080-6f55-499c-b2b7-b4307c484313-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8436be9-74c2-4d86-b0ee-a586098c8a4d]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:10 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 1 in 0.401s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:10 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95 Sep 01 11:35:10 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:11 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD Sep 01 11:35:11 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:11 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-502dda1a-6a53-4e13-8c9d-0615202cfc95" returned: 0 in 0.319s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Lock "cinder-quobyte-502dda1a-6a53-4e13-8c9d-0615202cfc95" released by "delete_volume" :: held 1.341s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:11 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Created reservations ['4f536254-e4bf-46e4-bde6-651da87a3e64', '1eabab96-71cf-4476-a9a7-260c6a862990', 'fb687200-b584-45c8-a2f9-32765be651d2', '25494c76-da92-4f30-8240-42219262994a'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:11 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:11 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:11 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:11 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Flow 'volume_create_manager' (0d0f9dd1-1db7-494d-b777-43d335c9b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fa23ea-e15a-4763-94a1-bffce53d12b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fa23ea-e15a-4763-94a1-bffce53d12b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-803185243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf0d8662c3a4925a3f86c72633c939c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:12Z,use_quota=True,user_id='040d0f830da74e599027294f920532ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80908cf-b4cd-458c-bf7b-73496366cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80908cf-b4cd-458c-bf7b-73496366cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30d9e30-3dbd-4d43-a173-a25a90f9768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30d9e30-3dbd-4d43-a173-a25a90f9768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340', 'volume_name': 'volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:11 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7bdea8-cb6e-4d83-b3e3-011b78219899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7bdea8-cb6e-4d83-b3e3-011b78219899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4128ac53-3aae-437d-b32a-8b0c83df83dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:11 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Volume 9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340', 'volume_size': 1} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-803185243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf0d8662c3a4925a3f86c72633c939c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:12Z,use_quota=True,user_id='040d0f830da74e599027294f920532ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Creating volume 9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:11 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Temporary image 0e29cca5-2534-45a9-8816-654501894681 is fetched for user c1bc1b5e607643eba92446768ce2d413. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:35:11 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Deleted volume successfully. Sep 01 11:35:11 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 1073741824 Sep 01 11:35:11 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-728eeb7a-2dea-438f-8eb0-bcc46c0c043e tempest-VolumeImageDependencyTests-622095528 None] Lock "cinder-502dda1a-6a53-4e13-8c9d-0615202cfc95-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e2580c-739e-449b-82b0-41df6889812f]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:11 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD Sep 01 11:35:11 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:12 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:12 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 1073741824" returned: 0 in 0.614s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:12 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD Sep 01 11:35:12 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:12 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 Sep 01 11:35:12 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:12 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:12 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" returned: 0 in 0.362s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f58695-bd68-4dc5-9cdb-35c005f5a621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7c860a76d24ddd8f0680079ece0880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:10Z,use_quota=True,user_id='c1bc1b5e607643eba92446768ce2d413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ff2f9fc-5c4c-4e5c-bcb4-84a3ef7e3da8),volume_type_id=1ff2f9fc-5c4c-4e5c-bcb4-84a3ef7e3da8)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Creating volume 47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:12 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:12 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 1073741824 Sep 01 11:35:12 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4128ac53-3aae-437d-b32a-8b0c83df83dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833c83f9-1e85-4298-9aa1-2162dafd6bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:12 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Volume volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 (9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340): created successfully Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833c83f9-1e85-4298-9aa1-2162dafd6bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Flow 'volume_create_manager' (0d0f9dd1-1db7-494d-b777-43d335c9b543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-508ce657-7f49-434b-9488-02bf346da0f6 tempest-VolumesExtendTest-201597005 None] Created volume successfully. Sep 01 11:35:13 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 1073741824" returned: 0 in 0.540s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:13 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:13 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:13 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 0 in 0.413s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Attempting download of 0e29cca5-2534-45a9-8816-654501894681 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e29cca5-2534-45a9-8816-654501894681', 'metadata': {}}])) to volume 47f58695-bd68-4dc5-9cdb-35c005f5a621. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0518014f-bd2e-4fc8-beaa-48090089aaf7]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:14 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37 Sep 01 11:35:14 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Creating offline snapshot 9a39ddf8-7ee4-45ac-83ab-488c501e9020 of volume 9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049c944-d378-4c40-bd01-2e17a34f2105]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:14 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37" returned: 0 in 0.535s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:14 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 Sep 01 11:35:14 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:14 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37 Sep 01 11:35:14 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:14 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" returned: 0 in 0.571s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:14 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 1G Sep 01 11:35:14 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:15 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37" returned: 1 in 0.628s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e29cca5-2534-45a9-8816-654501894681_1jrkdw37' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e067ab8f-803d-4e24-ab65-21bc7a9d214b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:15 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD Sep 01 11:35:15 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:15 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 1G" returned: 0 in 0.582s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:15 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 Sep 01 11:35:15 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:15 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:15 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD Sep 01 11:35:15 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:15 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020" returned: 0 in 0.459s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:15 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 is being set with open permissions: ugo+rw Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:15 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 Sep 01 11:35:15 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:15 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:15 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] 0e29cca5-2534-45a9-8816-654501894681 was raw, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:16 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:16 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:16 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:16 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info Sep 01 11:35:16 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:16 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 0 in 0.462s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e29cca5-2534-45a9-8816-654501894681_hi4y4mnndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:35:16 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:16 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 1G Sep 01 11:35:16 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:16 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:16 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info is being set with open permissions: ugo+rw Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:16 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info Sep 01 11:35:16 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Flow 'volume_create_manager' (a26cca5b-86ec-4501-97c7-56c96fcf0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b72084c-b98c-40ba-a6f8-284acfd70472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b72084c-b98c-40ba-a6f8-284acfd70472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f61091b-6f6c-4ea7-9c05-0f18d21a36a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a3dc3170d84581a7e63c8872a87fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:17Z,use_quota=True,user_id='6ffb464afb834be680a8d0a69862bb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7cea164-6865-4eb2-aa6a-1f351d579c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7cea164-6865-4eb2-aa6a-1f351d579c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef8fdbd-ac85-432a-9449-00d489316a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef8fdbd-ac85-432a-9449-00d489316a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f61091b-6f6c-4ea7-9c05-0f18d21a36a2', 'volume_name': 'volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9623ade-8508-469e-8808-e1db8a85db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9623ade-8508-469e-8808-e1db8a85db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:16 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0121048a-b38f-4f4c-a634-86e5c7ece209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Volume 4f61091b-6f6c-4ea7-9c05-0f18d21a36a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2', 'volume_size': 1} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 1G" returned: 0 in 0.405s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:16 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.info" returned: 0 in 0.316s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb188811-2334-4856-a38a-2e31ca96d3a4]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f61091b-6f6c-4ea7-9c05-0f18d21a36a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a3dc3170d84581a7e63c8872a87fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:17Z,use_quota=True,user_id='6ffb464afb834be680a8d0a69862bb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Creating volume 4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:16 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:16 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 1073741824 Sep 01 11:35:16 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-594998e5-fcfa-42b4-8024-f401cd5ffc68 tempest-VolumesExtendTest-201597005 None] Create snapshot completed successfully Sep 01 11:35:17 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:17 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:17 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 0 in 0.702s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:17 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:17 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:17 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 1073741824" returned: 0 in 0.983s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:18 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 Sep 01 11:35:18 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:18 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 1 in 0.726s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Downloaded image 0e29cca5-2534-45a9-8816-654501894681 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e29cca5-2534-45a9-8816-654501894681', 'metadata': {}}])) to volume 47f58695-bd68-4dc5-9cdb-35c005f5a621 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Temporary image 0e29cca5-2534-45a9-8816-654501894681 for user c1bc1b5e607643eba92446768ce2d413 is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Marking volume 47f58695-bd68-4dc5-9cdb-35c005f5a621 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Copying metadata from image 0e29cca5-2534-45a9-8816-654501894681 to 47f58695-bd68-4dc5-9cdb-35c005f5a621. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Creating volume glance metadata for volume 47f58695-bd68-4dc5-9cdb-35c005f5a621 backed by image 0e29cca5-2534-45a9-8816-654501894681 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0e29cca5-2534-45a9-8816-654501894681', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'da0618c00382fd1d21db5bbf26b7abb6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:35:18 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2" returned: 0 in 0.502s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.563s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d16427-a31a-4a08-9ab6-fc65651e9894]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0121048a-b38f-4f4c-a634-86e5c7ece209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5fe13d-4431-4dea-be59-81cab0e99cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Volume volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 (4f61091b-6f6c-4ea7-9c05-0f18d21a36a2): created successfully Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5fe13d-4431-4dea-be59-81cab0e99cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Flow 'volume_create_manager' (a26cca5b-86ec-4501-97c7-56c96fcf0a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ef40fe-e6cf-4f38-a655-2fc428782af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f58695-bd68-4dc5-9cdb-35c005f5a621', 'volume_size': 1, 'image_id': '0e29cca5-2534-45a9-8816-654501894681', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e29cca5-2534-45a9-8816-654501894681', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da0618c00382fd1d21db5bbf26b7abb6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d7c860a76d24ddd8f0680079ece0880', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35e5cc7385130ceb0e3ddc205d5002f27bbfca4c1c9e1ecb8d45d7aafd4bce16c48cf7e24f402472ddd4b34f66b9fa0d938a7814aa6454736087c44bf1fd0220', 'id': '0e29cca5-2534-45a9-8816-654501894681', 'created_at': datetime.datetime(2026, 9, 1, 9, 35, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 35, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e29cca5-2534-45a9-8816-654501894681/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54c5130-6863-4952-bae0-2c74b9f0292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-47e2738c-69ab-4281-8ecb-1c2a8a289fcf tempest-CinderUnicodeTest-237538168 None] Created volume successfully. Sep 01 11:35:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Volume volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 (47f58695-bd68-4dc5-9cdb-35c005f5a621): created successfully Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54c5130-6863-4952-bae0-2c74b9f0292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Flow 'volume_create_manager' (74ddd0dd-cc16-4e8f-8ab3-2f56df07da1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f42b3930-22f7-4935-8dee-53532831a485 tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Created volume successfully. Sep 01 11:35:18 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 Sep 01 11:35:18 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:19 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" returned: 0 in 0.570s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 2G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Acquiring lock "cinder-47f58695-bd68-4dc5-9cdb-35c005f5a621-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "cinder-47f58695-bd68-4dc5-9cdb-35c005f5a621-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Acquiring lock "cinder-quobyte-47f58695-bd68-4dc5-9cdb-35c005f5a621" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 2G" returned: 0 in 0.411s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.101s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "cinder-quobyte-47f58695-bd68-4dc5-9cdb-35c005f5a621" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4468b2e-1623-4673-9b0b-423ff83e7c26]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Flow 'volume_create_manager' (fee3f10c-67e1-430d-bb55-e2425e278a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5bbcb-d821-49bf-9a49-375cb48d94bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e01ba902-ac72-479a-8f1b-5b6d5821d40c tempest-VolumesExtendTest-201597005 None] Extend volume completed successfully. Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5bbcb-d821-49bf-9a49-375cb48d94bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1038700542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59a63d5-2184-4c42-9b01-aba065e0917a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a3dc3170d84581a7e63c8872a87fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:20Z,use_quota=True,user_id='6ffb464afb834be680a8d0a69862bb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f91b65-bc8c-48fd-b698-04a19578ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f91b65-bc8c-48fd-b698-04a19578ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037b70f7-1848-4f1e-89fd-e2cc827f534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037b70f7-1848-4f1e-89fd-e2cc827f534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59a63d5-2184-4c42-9b01-aba065e0917a', 'volume_name': 'volume-c59a63d5-2184-4c42-9b01-aba065e0917a', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92535a99-2fdc-4f90-9b0b-754a699219db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:19 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:19 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92535a99-2fdc-4f90-9b0b-754a699219db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4082db-f436-4514-a423-38aa4b67d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:19 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Volume c59a63d5-2184-4c42-9b01-aba065e0917a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59a63d5-2184-4c42-9b01-aba065e0917a', 'volume_size': 1} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1038700542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59a63d5-2184-4c42-9b01-aba065e0917a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a3dc3170d84581a7e63c8872a87fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:20Z,use_quota=True,user_id='6ffb464afb834be680a8d0a69862bb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Creating volume c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:19 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:19 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a 1073741824 Sep 01 11:35:19 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:20 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 0 in 0.417s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:20 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:20 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:20 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a 1073741824" returned: 0 in 0.584s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-9a39ddf8-7ee4-45ac-83ab-488c501e9020-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:20 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a Sep 01 11:35:20 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Lock "cinder-9a39ddf8-7ee4-45ac-83ab-488c501e9020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:20 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-quobyte-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 1 in 0.600s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-quobyte-9a39ddf8-7ee4-45ac-83ab-488c501e9020" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:20 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621 Sep 01 11:35:20 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-9a39ddf8-7ee4-45ac-83ab-488c501e9020" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Deleting offline snapshot 9a39ddf8-7ee4-45ac-83ab-488c501e9020 of volume 9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] snapshot_file for this snap is: volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1785a69d-2f26-4640-9757-e96ce95e9b7b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:21 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 Sep 01 11:35:21 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:21 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a" returned: 0 in 0.573s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4082db-f436-4514-a423-38aa4b67d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59a63d5-2184-4c42-9b01-aba065e0917a', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:21 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec6723-035b-4916-85bb-ec4cf95c8ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-47f58695-bd68-4dc5-9cdb-35c005f5a621" returned: 0 in 0.450s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "cinder-quobyte-47f58695-bd68-4dc5-9cdb-35c005f5a621" released by "delete_volume" :: held 1.588s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Volume volume-c59a63d5-2184-4c42-9b01-aba065e0917a (c59a63d5-2184-4c42-9b01-aba065e0917a): created successfully Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec6723-035b-4916-85bb-ec4cf95c8ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Flow 'volume_create_manager' (fee3f10c-67e1-430d-bb55-e2425e278a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8345015a-8565-4e6d-b012-7052b68bd697 tempest-CinderUnicodeTest-237538168 None] Created volume successfully. Sep 01 11:35:21 devstack cinder-volume[87144]: WARNING cinder.quota [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:35:21 devstack cinder-volume[87144]: WARNING cinder.quota [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Created reservations ['f27a5c6c-a500-4549-a83c-3bcce3e96b1b', '6594d4cc-7435-430d-9ca4-fd2d672d6179', '13398c91-8d82-4a34-a148-587f5f0f674c', 'fdd76c2a-3b84-415e-aa61-c474f97de162'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:21 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020" returned: 0 in 0.541s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c42d384-e8d7-4f64-bd0f-cb646a0ebc8c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:21 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:21 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:21 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 Sep 01 11:35:21 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:21 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.403s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Deleted volume successfully. Sep 01 11:35:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f260980d-2f4d-4fcf-8a2d-1ac5dc4b099f tempest-VolumeAndVolumeTypeFromImageTest-766252543 None] Lock "cinder-47f58695-bd68-4dc5-9cdb-35c005f5a621-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:22 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" returned: 0 in 0.529s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:22 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 Sep 01 11:35:22 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Creating offline snapshot 16f4eeb9-98bf-4211-ad02-69e347e02050 of volume c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4759ea23-9957-42ff-8c3a-120daadcf7ad]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:22 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a Sep 01 11:35:22 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:22 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020" returned: 0 in 0.675s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:22 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020 Sep 01 11:35:22 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:23 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:23 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a" returned: 0 in 0.647s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340.9a39ddf8-7ee4-45ac-83ab-488c501e9020" returned: 0 in 0.440s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:23 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 1G Sep 01 11:35:23 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-9a39ddf8-7ee4-45ac-83ab-488c501e9020" released by "_delete_snapshot" :: held 2.367s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" released by "delete_snapshot" :: held 2.421s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Created reservations ['14a731e6-d7d4-40f4-8f58-63bd214efb82', '78edf24f-4df0-4294-8287-e3a5542e537e', 'e041be92-0e2c-4fd9-bd0b-86b18087069e', '4c038ab2-65ab-4225-a14f-ee7c12011319'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Delete snapshot completed successfully. Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f7a70b16-6595-45b6-ac61-85b63236763d tempest-VolumesExtendTest-201597005 None] Lock "cinder-9a39ddf8-7ee4-45ac-83ab-488c501e9020-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:23 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 1G" returned: 0 in 0.556s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c59a63d5-2184-4c42-9b01-aba065e0917a -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:23 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c59a63d5-2184-4c42-9b01-aba065e0917a -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 Sep 01 11:35:23 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:24 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c59a63d5-2184-4c42-9b01-aba065e0917a -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050" returned: 0 in 0.414s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:24 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 is being set with open permissions: ugo+rw Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:24 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 Sep 01 11:35:24 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Lock "cinder-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Acquiring lock "cinder-quobyte-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38266d5-46e3-4be7-bd4e-07762997df75]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:24 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 Sep 01 11:35:24 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:24 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050" returned: 0 in 0.430s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:24 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info Sep 01 11:35:24 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:24 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" returned: 0 in 0.546s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:24 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info" returned: 0 in 0.321s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:24 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info is being set with open permissions: ugo+rw Sep 01 11:35:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:24 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340 Sep 01 11:35:24 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:24 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info Sep 01 11:35:24 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:25 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.info" returned: 0 in 0.313s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:25 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Lock "cinder-quobyte-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340" released by "delete_volume" :: held 1.026s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-522fb2bc-aa1f-43d5-bf9d-be2b68b99adb tempest-CinderUnicodeTest-237538168 None] Create snapshot completed successfully Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Created reservations ['f210b37e-1736-4bda-870c-82c3f66e9058', '9f7d78d2-f368-4692-9259-9c401161f59d', 'eb8e9e75-3985-4ac1-88f5-d796f90c48ba', '56f8fa91-8f56-48ab-ba23-2f00cbd6de0b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:25 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:25 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-16f4eeb9-98bf-4211-ad02-69e347e02050-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Lock "cinder-16f4eeb9-98bf-4211-ad02-69e347e02050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-quobyte-c59a63d5-2184-4c42-9b01-aba065e0917a" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-c59a63d5-2184-4c42-9b01-aba065e0917a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-quobyte-16f4eeb9-98bf-4211-ad02-69e347e02050" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-16f4eeb9-98bf-4211-ad02-69e347e02050" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Deleting offline snapshot 16f4eeb9-98bf-4211-ad02-69e347e02050 of volume c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] snapshot_file for this snap is: volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c542ea9-7dbf-4f07-bf90-4c3c02e98aaa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:25 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.320s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Deleted volume successfully. Sep 01 11:35:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-36fedac9-80c0-48b0-9133-4701242fb31a tempest-VolumesExtendTest-201597005 None] Lock "cinder-9ec1d9e7-7f20-42ca-b5ec-d4790bdbd340-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:25 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 Sep 01 11:35:25 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:26 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050" returned: 0 in 0.431s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c59a63d5-2184-4c42-9b01-aba065e0917a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:35:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d43030-afb5-4dec-b3d3-b9a3aba06d5f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:26 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a Sep 01 11:35:26 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:26 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a" returned: 0 in 0.519s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:26 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 Sep 01 11:35:26 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:27 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:27 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050 Sep 01 11:35:27 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:27 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a.16f4eeb9-98bf-4211-ad02-69e347e02050" returned: 0 in 0.346s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-16f4eeb9-98bf-4211-ad02-69e347e02050" released by "_delete_snapshot" :: held 1.928s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-c59a63d5-2184-4c42-9b01-aba065e0917a" released by "delete_snapshot" :: held 1.968s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Created reservations ['ebaa40af-7b6e-4d2c-8cdf-82dd9c733829', '51c5a660-daff-466a-976b-58625d7a06f1', 'f91e957b-ff1e-46ac-8582-32c97a1f2d3f', '47ee237d-d85b-4b4e-a5a3-5ae188c97882'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Delete snapshot completed successfully. Sep 01 11:35:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3ad81634-6154-401f-be73-2b1848bf0b5d tempest-CinderUnicodeTest-237538168 None] Lock "cinder-16f4eeb9-98bf-4211-ad02-69e347e02050-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (baafeff7-586a-4dbe-9b36-bfd5caf02995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fa5f6f-5962-402e-afbc-fb0ad32a4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fa5f6f-5962-402e-afbc-fb0ad32a4f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934854461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5676a90-f87a-4786-9a70-6f7e4d040dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:28Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de75d3f-8296-478b-ac8f-343ead4787e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de75d3f-8296-478b-ac8f-343ead4787e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22401397-6d75-422e-ab50-22e8ea6e1e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22401397-6d75-422e-ab50-22e8ea6e1e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5676a90-f87a-4786-9a70-6f7e4d040dd0', 'volume_name': 'volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77abb0ef-20ed-4cbb-94f5-7f8b2543e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77abb0ef-20ed-4cbb-94f5-7f8b2543e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581a4d59-23f6-42a9-9d46-620d260e3f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:28 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume a5676a90-f87a-4786-9a70-6f7e4d040dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0', 'volume_size': 1} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934854461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5676a90-f87a-4786-9a70-6f7e4d040dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:28Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating volume a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:28 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:28 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 1073741824 Sep 01 11:35:28 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-c59a63d5-2184-4c42-9b01-aba065e0917a-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-c59a63d5-2184-4c42-9b01-aba065e0917a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-quobyte-c59a63d5-2184-4c42-9b01-aba065e0917a" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-c59a63d5-2184-4c42-9b01-aba065e0917a" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1ca00-12ae-4537-a2ce-28e76ee226fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:29 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 1073741824" returned: 0 in 0.577s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:29 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a Sep 01 11:35:29 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:29 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 Sep 01 11:35:29 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:29 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a" returned: 0 in 0.479s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:29 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0" returned: 0 in 0.336s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:29 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a Sep 01 11:35:29 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581a4d59-23f6-42a9-9d46-620d260e3f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb811392-1bfc-452c-96cb-3ef535d4d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:29 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 (a5676a90-f87a-4786-9a70-6f7e4d040dd0): created successfully Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb811392-1bfc-452c-96cb-3ef535d4d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (baafeff7-586a-4dbe-9b36-bfd5caf02995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8ba0d197-d28d-4a3d-9307-a6e693ec7033 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created volume successfully. Sep 01 11:35:29 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c59a63d5-2184-4c42-9b01-aba065e0917a" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-c59a63d5-2184-4c42-9b01-aba065e0917a" released by "delete_volume" :: held 0.852s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:29 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Created reservations ['41f77b8b-7d50-484a-893f-35d4cd87da30', '1206f618-6ed5-4cfa-b24b-99dc73aee719', '4e3dded1-a91e-42b9-8912-a2e475e8fb11', 'f3c35b90-464b-4a0a-9499-e634384ac1b3'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:30 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:30 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "cinder-quobyte-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d304d5-6763-4608-b485-ad2ffba9f0ab]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:30 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.380s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Deleted volume successfully. Sep 01 11:35:30 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 Sep 01 11:35:30 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7e1497fe-3c51-49ef-b2de-0346c3ea7f10 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-c59a63d5-2184-4c42-9b01-aba065e0917a-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:30 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Flow 'volume_create_manager' (263f4a06-7952-4126-a134-aaed17037177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c27b65-3c35-4bba-a22b-8c9b2818c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2" returned: 0 in 0.527s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c27b65-3c35-4bba-a22b-8c9b2818c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1539963468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67445399-0c51-4e04-b98f-1d72a736929f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a098325ab13546a587118ddada238471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:31Z,use_quota=True,user_id='a02d24443ca945ebb1acb62b91cb654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187c7cd8-1b39-4625-8556-885a91aa5ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:30 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2 Sep 01 11:35:30 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187c7cd8-1b39-4625-8556-885a91aa5ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212f1418-7ab9-4921-b6e6-b75a31fd82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212f1418-7ab9-4921-b6e6-b75a31fd82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67445399-0c51-4e04-b98f-1d72a736929f', 'volume_name': 'volume-67445399-0c51-4e04-b98f-1d72a736929f', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7de570-ab75-4eec-987a-025cc82cc752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7de570-ab75-4eec-987a-025cc82cc752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c475562-3d2a-4d52-a4d9-d754c5c39a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Volume 67445399-0c51-4e04-b98f-1d72a736929f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67445399-0c51-4e04-b98f-1d72a736929f', 'volume_size': 1} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1539963468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67445399-0c51-4e04-b98f-1d72a736929f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a098325ab13546a587118ddada238471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:31Z,use_quota=True,user_id='a02d24443ca945ebb1acb62b91cb654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Creating volume 67445399-0c51-4e04-b98f-1d72a736929f {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:30 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:31 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f 1073741824 Sep 01 11:35:31 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:31 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2" returned: 0 in 0.328s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-quobyte-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2" released by "delete_volume" :: held 0.917s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Created reservations ['4cbefbc1-8f7b-4079-80a4-f8d22bc025fd', 'd16b685a-5807-4173-ad6b-b3644bf1d059', '805b5c89-a44a-4524-bc31-57f6acb383b3', '16b4f848-f3d4-406e-9231-741e015df8a2'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:31 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:31 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:31 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f 1073741824" returned: 0 in 0.599s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:31 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.273s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Deleted volume successfully. Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0d73621-3592-481d-8342-b0f2df651ff6 tempest-CinderUnicodeTest-237538168 None] Lock "cinder-4f61091b-6f6c-4ea7-9c05-0f18d21a36a2-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:31 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f Sep 01 11:35:31 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:31 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f" returned: 0 in 0.259s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.867s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating offline snapshot 8434e9af-ac4d-4019-a2ff-101d2d704e5d of volume a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c475562-3d2a-4d52-a4d9-d754c5c39a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67445399-0c51-4e04-b98f-1d72a736929f', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4c73c2-d389-4529-863b-574a1e68e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b620d841-e5ab-4133-b239-e499bc0ff10c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Volume volume-67445399-0c51-4e04-b98f-1d72a736929f (67445399-0c51-4e04-b98f-1d72a736929f): created successfully Sep 01 11:35:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4c73c2-d389-4529-863b-574a1e68e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Flow 'volume_create_manager' (263f4a06-7952-4126-a134-aaed17037177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-720cf651-0e5a-4d2d-9445-d472cf17f5e1 tempest-VolumesListTestJSON-2095576423 None] Created volume successfully. Sep 01 11:35:32 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 Sep 01 11:35:32 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:32 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0" returned: 0 in 0.400s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:32 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d 1G Sep 01 11:35:32 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:32 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d 1G" returned: 0 in 0.469s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:32 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d Sep 01 11:35:32 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:33 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d" returned: 0 in 0.336s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:33 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d is being set with open permissions: ugo+rw Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:33 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d Sep 01 11:35:33 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:33 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Flow 'volume_create_manager' (891bc420-eb53-4f76-a415-225b10d1d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0444aa2-ffd0-4a8a-b281-d8fad3d510b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0444aa2-ffd0-4a8a-b281-d8fad3d510b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-909866926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab18a4c5-509e-483d-af43-9265fdb9a488,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a098325ab13546a587118ddada238471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:33Z,use_quota=True,user_id='a02d24443ca945ebb1acb62b91cb654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7c5ab2-a809-4e8e-9272-763d68eedf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7c5ab2-a809-4e8e-9272-763d68eedf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be93aa5-ca69-413b-a75d-edce6ca4d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be93aa5-ca69-413b-a75d-edce6ca4d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab18a4c5-509e-483d-af43-9265fdb9a488', 'volume_name': 'volume-ab18a4c5-509e-483d-af43-9265fdb9a488', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13baf231-458f-491a-8acd-601a68b58efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13baf231-458f-491a-8acd-601a68b58efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8dc02f-8af2-4961-b739-96a378d46211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Volume ab18a4c5-509e-483d-af43-9265fdb9a488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab18a4c5-509e-483d-af43-9265fdb9a488', 'volume_size': 1} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:33 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info Sep 01 11:35:33 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:33 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:33 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info is being set with open permissions: ugo+rw Sep 01 11:35:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:33 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info Sep 01 11:35:33 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:34 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.info" returned: 0 in 0.262s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-909866926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab18a4c5-509e-483d-af43-9265fdb9a488,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a098325ab13546a587118ddada238471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:33Z,use_quota=True,user_id='a02d24443ca945ebb1acb62b91cb654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Creating volume ab18a4c5-509e-483d-af43-9265fdb9a488 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:34 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:34 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 1073741824 Sep 01 11:35:34 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:34 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-28507c33-26e3-43af-9c66-eab9a2179950 tempest-CreateVolumesFromSnapshotTest-608291781 None] Create snapshot completed successfully Sep 01 11:35:34 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 1073741824" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=118,cinder:UPDATE=126,cinder:INSERT=48,cinder:DELETE=10 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=125,cinder:INSERT=48,cinder:UPDATE=154,cinder:DELETE=13 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:34 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 Sep 01 11:35:34 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:34 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488" returned: 0 in 0.262s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8dc02f-8af2-4961-b739-96a378d46211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab18a4c5-509e-483d-af43-9265fdb9a488', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937ba06f-0f3d-4f2a-a89b-60c1c749b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:34 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Volume volume-ab18a4c5-509e-483d-af43-9265fdb9a488 (ab18a4c5-509e-483d-af43-9265fdb9a488): created successfully Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937ba06f-0f3d-4f2a-a89b-60c1c749b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Flow 'volume_create_manager' (891bc420-eb53-4f76-a415-225b10d1d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c16d8017-e9c5-4395-beac-18707d6e34d9 tempest-VolumesListTestJSON-2095576423 None] Created volume successfully. Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Flow 'volume_create_manager' (e8fc75ab-f85d-4bb3-9335-48bbcd06958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27538960-b5d9-429b-8111-8fb672021cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27538960-b5d9-429b-8111-8fb672021cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370662581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7781896d-b732-44c7-96a6-685fc4a672ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be5580822d47ceac7a532bc99c6718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:35Z,use_quota=True,user_id='0978676847e44b5fbbd2b57c93ef76b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309056e6-ed8f-4c56-8f24-31c7d1dfca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309056e6-ed8f-4c56-8f24-31c7d1dfca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5558cc33-c0bb-460d-aa7a-88e5f499c4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5558cc33-c0bb-460d-aa7a-88e5f499c4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7781896d-b732-44c7-96a6-685fc4a672ce', 'volume_name': 'volume-7781896d-b732-44c7-96a6-685fc4a672ce', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74b5f24-f4e6-46ef-b051-5169273f2a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74b5f24-f4e6-46ef-b051-5169273f2a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1872ab1-ba90-4a2b-99df-1b402704392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Volume 7781896d-b732-44c7-96a6-685fc4a672ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7781896d-b732-44c7-96a6-685fc4a672ce', 'volume_size': 1} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370662581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7781896d-b732-44c7-96a6-685fc4a672ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be5580822d47ceac7a532bc99c6718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:35Z,use_quota=True,user_id='0978676847e44b5fbbd2b57c93ef76b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Creating volume 7781896d-b732-44c7-96a6-685fc4a672ce {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:35 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:35 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce 1073741824 Sep 01 11:35:35 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (29b929d2-5397-4894-92f1-dcc596b1fe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70b0c80-2458-469c-86bb-959b1faea3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70b0c80-2458-469c-86bb-959b1faea3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316278495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a3d603-0a53-43f2-97e3-f9793307b4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e8609d-74c0-408d-b397-8c5929591345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e8609d-74c0-408d-b397-8c5929591345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e379e8-10f0-497d-a5ac-4ab730d9b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e379e8-10f0-497d-a5ac-4ab730d9b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a3d603-0a53-43f2-97e3-f9793307b4f9', 'volume_name': 'volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb44460-07fa-4cd6-91cc-28bddcfc3893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb44460-07fa-4cd6-91cc-28bddcfc3893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce30e3f7-e845-4db6-8056-23bd02b418f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume a6a3d603-0a53-43f2-97e3-f9793307b4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9', 'volume_size': 1} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:35 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce 1073741824" returned: 0 in 0.531s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:35 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce Sep 01 11:35:35 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (eb2b82f8-f961-444c-9320-2ebca0ee208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff031af1-2e8d-43df-b6ec-2549012430bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff031af1-2e8d-43df-b6ec-2549012430bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142301769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190afc3a-7a7a-40ef-b325-e639662e4b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a154259-9717-410c-91e2-aba27b2f1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a154259-9717-410c-91e2-aba27b2f1c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0861ad8d-e9b7-4a59-8a59-183137d0ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0861ad8d-e9b7-4a59-8a59-183137d0ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190afc3a-7a7a-40ef-b325-e639662e4b34', 'volume_name': 'volume-190afc3a-7a7a-40ef-b325-e639662e4b34', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36424d55-0c5d-47c8-8b68-b4c17a333a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36424d55-0c5d-47c8-8b68-b4c17a333a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38362272-f0d5-450f-a980-e671f1baf777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume 190afc3a-7a7a-40ef-b325-e639662e4b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190afc3a-7a7a-40ef-b325-e639662e4b34', 'volume_size': 1} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:36 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce" returned: 0 in 0.365s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316278495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a3d603-0a53-43f2-97e3-f9793307b4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating volume a6a3d603-0a53-43f2-97e3-f9793307b4f9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:36 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 1073741824 Sep 01 11:35:36 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1872ab1-ba90-4a2b-99df-1b402704392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7781896d-b732-44c7-96a6-685fc4a672ce', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05901b84-9e27-4811-a224-2154a1906246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Flow 'volume_create_manager' (c5134f0e-2f3c-411d-9025-7f63e36e1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5256a60-18b7-4dd8-ac66-d931de32f8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Volume volume-7781896d-b732-44c7-96a6-685fc4a672ce (7781896d-b732-44c7-96a6-685fc4a672ce): created successfully Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05901b84-9e27-4811-a224-2154a1906246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Flow 'volume_create_manager' (e8fc75ab-f85d-4bb3-9335-48bbcd06958b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5256a60-18b7-4dd8-ac66-d931de32f8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1934568780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c077dc2-292a-40d5-9250-60015107a158,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a098325ab13546a587118ddada238471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='a02d24443ca945ebb1acb62b91cb654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02733e96-4951-491d-8b50-b450a5485b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02733e96-4951-491d-8b50-b450a5485b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d05878c-11ad-47f6-bb93-207c67530b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d05878c-11ad-47f6-bb93-207c67530b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c077dc2-292a-40d5-9250-60015107a158', 'volume_name': 'volume-0c077dc2-292a-40d5-9250-60015107a158', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66b34ae-e688-4ecb-ac43-7ee9afafb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66b34ae-e688-4ecb-ac43-7ee9afafb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d34460a-1eed-498d-94dc-7cd33e76332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Volume 0c077dc2-292a-40d5-9250-60015107a158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c077dc2-292a-40d5-9250-60015107a158', 'volume_size': 1} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-83982ea8-3baa-451a-bf1a-25f8b5a18489 tempest-ProjectReaderTests-2021660792 None] Created volume successfully. Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (ed9cf9cc-3928-4f1e-b51f-68d029b4248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf7422c-1bec-44b3-a1fa-69f80559b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf7422c-1bec-44b3-a1fa-69f80559b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162925186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a907f3-c174-4436-ba2d-d905edf185dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d585bd39-38ea-4494-9e9e-66a72d1e4463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d585bd39-38ea-4494-9e9e-66a72d1e4463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907cf1dd-15d1-402a-9890-c0ec2df58774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907cf1dd-15d1-402a-9890-c0ec2df58774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a907f3-c174-4436-ba2d-d905edf185dc', 'volume_name': 'volume-e4a907f3-c174-4436-ba2d-d905edf185dc', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac22abe-e0d5-4143-b4bd-b5b724a2a15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac22abe-e0d5-4143-b4bd-b5b724a2a15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7ddcec-8df5-4752-8cf6-4bd371c99b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume e4a907f3-c174-4436-ba2d-d905edf185dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a907f3-c174-4436-ba2d-d905edf185dc', 'volume_size': 1} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:36 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 1073741824" returned: 0 in 0.501s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:36 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 Sep 01 11:35:36 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (3ac6c416-44c8-47c7-bc66-4bdff15dc7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23546e39-a9cf-4202-b042-db128a2a58d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23546e39-a9cf-4202-b042-db128a2a58d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1202286508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b8f10b-b08e-48fe-9aa3-102f7a88ea40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:37Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5e2a1b-21fe-440f-9a54-a2de5e67785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5e2a1b-21fe-440f-9a54-a2de5e67785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b358ce3b-c6ac-46ef-9542-d73e8661e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b358ce3b-c6ac-46ef-9542-d73e8661e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b8f10b-b08e-48fe-9aa3-102f7a88ea40', 'volume_name': 'volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6c5079-b77c-432f-ae62-d924fffe661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6c5079-b77c-432f-ae62-d924fffe661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87612c7f-9237-45f2-8b66-3eee9d6015ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume f7b8f10b-b08e-48fe-9aa3-102f7a88ea40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40', 'volume_size': 1} Sep 01 11:35:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:37 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9" returned: 0 in 0.297s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142301769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190afc3a-7a7a-40ef-b325-e639662e4b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating volume 190afc3a-7a7a-40ef-b325-e639662e4b34 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce30e3f7-e845-4db6-8056-23bd02b418f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10551fdf-9539-43a5-a2ea-78c93c0b428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 1073741824 Sep 01 11:35:37 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 (a6a3d603-0a53-43f2-97e3-f9793307b4f9): created successfully Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10551fdf-9539-43a5-a2ea-78c93c0b428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (29b929d2-5397-4894-92f1-dcc596b1fe08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7e7a417b-b640-4c08-82bc-6651af030f2a tempest-CreateVolumesFromSnapshotTest-608291781 None] Created volume successfully. Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (a3e57ea4-88d1-4127-ab08-8576ad894798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f1a892-7716-49b6-8afc-738ad9c0e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f1a892-7716-49b6-8afc-738ad9c0e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500047026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9aa900-1dee-4c8c-b7de-d9d3476b0f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:37Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e624a0b9-3b67-488d-b4cf-1e02868950bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e624a0b9-3b67-488d-b4cf-1e02868950bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655ed816-0a13-471b-8c77-fc02448881d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655ed816-0a13-471b-8c77-fc02448881d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9aa900-1dee-4c8c-b7de-d9d3476b0f21', 'volume_name': 'volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5ce2f8-68ca-427e-b8aa-0e2de4a3a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5ce2f8-68ca-427e-b8aa-0e2de4a3a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f020b1b-6f81-413d-85b8-54211426ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume 7d9aa900-1dee-4c8c-b7de-d9d3476b0f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21', 'volume_size': 1} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "cinder-7781896d-b732-44c7-96a6-685fc4a672ce-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Lock "cinder-7781896d-b732-44c7-96a6-685fc4a672ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "cinder-quobyte-7781896d-b732-44c7-96a6-685fc4a672ce" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Lock "cinder-quobyte-7781896d-b732-44c7-96a6-685fc4a672ce" acquired by "delete_volume" :: waited 0.013s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:37 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 1073741824" returned: 0 in 0.511s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a19cb8-ad73-4b4b-9fe4-182111ce1172]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:37 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 Sep 01 11:35:37 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:37 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce Sep 01 11:35:37 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:37 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34" returned: 0 in 0.249s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1934568780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c077dc2-292a-40d5-9250-60015107a158,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a098325ab13546a587118ddada238471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='a02d24443ca945ebb1acb62b91cb654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Creating volume 0c077dc2-292a-40d5-9250-60015107a158 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38362272-f0d5-450f-a980-e671f1baf777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190afc3a-7a7a-40ef-b325-e639662e4b34', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:37 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 1073741824 Sep 01 11:35:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68268357-3ad2-47a7-8b94-54a95d21468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:37 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume volume-190afc3a-7a7a-40ef-b325-e639662e4b34 (190afc3a-7a7a-40ef-b325-e639662e4b34): created successfully Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68268357-3ad2-47a7-8b94-54a95d21468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (eb2b82f8-f961-444c-9320-2ebca0ee208d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1c671c13-8cb7-499a-95d7-dc63503e1954 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created volume successfully. Sep 01 11:35:38 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce" returned: 0 in 0.396s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:38 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce Sep 01 11:35:38 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:38 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7781896d-b732-44c7-96a6-685fc4a672ce" returned: 0 in 0.282s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Lock "cinder-quobyte-7781896d-b732-44c7-96a6-685fc4a672ce" released by "delete_volume" :: held 0.715s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Created reservations ['e12be185-c387-4dc0-b17c-056725adaf85', 'c701b025-438e-4ca0-b68a-ca8b9ce603c1', '3a080417-aa87-4189-8ed5-a5336fce8143', '277953a5-25ad-4566-be17-73cfd9f5be2e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:38 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 1073741824" returned: 0 in 0.491s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:38 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:38 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:38 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 Sep 01 11:35:38 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:38 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.253s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Deleted volume successfully. Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-acba9e37-2ffe-4930-81de-5ea1785b8451 tempest-ProjectReaderTests-2021660792 None] Lock "cinder-7781896d-b732-44c7-96a6-685fc4a672ce-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:38 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162925186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a907f3-c174-4436-ba2d-d905edf185dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:36Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating volume e4a907f3-c174-4436-ba2d-d905edf185dc {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:38 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d34460a-1eed-498d-94dc-7cd33e76332d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c077dc2-292a-40d5-9250-60015107a158', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:38 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc 1073741824 Sep 01 11:35:38 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73561e6-766f-4625-b539-2fb98e37f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Volume volume-0c077dc2-292a-40d5-9250-60015107a158 (0c077dc2-292a-40d5-9250-60015107a158): created successfully Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73561e6-766f-4625-b539-2fb98e37f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Flow 'volume_create_manager' (c5134f0e-2f3c-411d-9025-7f63e36e1350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-287858fa-73d9-4e09-9aac-d42b7758d2ab tempest-VolumesListTestJSON-2095576423 None] Created volume successfully. Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Flow 'volume_create_manager' (97ad8069-362d-4e79-b882-86ba772dccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71311b9d-50a0-4e43-ab2a-1d99c6fd364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:39 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc 1073741824" returned: 0 in 0.448s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71311b9d-50a0-4e43-ab2a-1d99c6fd364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024439771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1780422d-e64b-452b-acea-702c9255caf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be5580822d47ceac7a532bc99c6718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:39Z,use_quota=True,user_id='0978676847e44b5fbbd2b57c93ef76b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab44d11-8e48-4e46-b072-9459a2666554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab44d11-8e48-4e46-b072-9459a2666554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ad81c6-5762-4380-817c-24cc16f66c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ad81c6-5762-4380-817c-24cc16f66c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1780422d-e64b-452b-acea-702c9255caf0', 'volume_name': 'volume-1780422d-e64b-452b-acea-702c9255caf0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a51861-c6bc-45a5-b24b-9b947c263efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a51861-c6bc-45a5-b24b-9b947c263efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674ee8ed-222b-4325-993a-9c33793f0d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:39 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Volume 1780422d-e64b-452b-acea-702c9255caf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1780422d-e64b-452b-acea-702c9255caf0', 'volume_size': 1} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:39 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc Sep 01 11:35:39 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:39 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.661s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1202286508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b8f10b-b08e-48fe-9aa3-102f7a88ea40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:37Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating volume f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:39 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:39 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 1073741824 Sep 01 11:35:39 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7ddcec-8df5-4752-8cf6-4bd371c99b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a907f3-c174-4436-ba2d-d905edf185dc', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aabd79-8a6b-4081-bcac-2fbba4731a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:39 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume volume-e4a907f3-c174-4436-ba2d-d905edf185dc (e4a907f3-c174-4436-ba2d-d905edf185dc): created successfully Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aabd79-8a6b-4081-bcac-2fbba4731a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (ed9cf9cc-3928-4f1e-b51f-68d029b4248d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-12c82a73-4ddb-4dc6-89d0-eb1f04a2e743 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created volume successfully. Sep 01 11:35:40 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 1073741824" returned: 0 in 0.547s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:40 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 Sep 01 11:35:40 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:40 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.185s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500047026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9aa900-1dee-4c8c-b7de-d9d3476b0f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5530e4cb054426b8945c8ce340c033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:37Z,use_quota=True,user_id='85812f3e78e245249bc26285670b0e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Creating volume 7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:40 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:40 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 1073741824 Sep 01 11:35:40 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87612c7f-9237-45f2-8b66-3eee9d6015ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3fa1ce-81f7-4a67-91fc-b11faabb137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 (f7b8f10b-b08e-48fe-9aa3-102f7a88ea40): created successfully Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3fa1ce-81f7-4a67-91fc-b11faabb137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (3ac6c416-44c8-47c7-bc66-4bdff15dc7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7a4353b2-b077-4ecc-a34c-69bda6d259e6 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created volume successfully. Sep 01 11:35:40 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 1073741824" returned: 0 in 0.470s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:41 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 Sep 01 11:35:41 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:41 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024439771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1780422d-e64b-452b-acea-702c9255caf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be5580822d47ceac7a532bc99c6718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:39Z,use_quota=True,user_id='0978676847e44b5fbbd2b57c93ef76b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Creating volume 1780422d-e64b-452b-acea-702c9255caf0 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:41 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f020b1b-6f81-413d-85b8-54211426ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:41 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 1073741824 Sep 01 11:35:41 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158a8a7b-596c-4382-9ee9-f87a0b1cee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:41 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Volume volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 (7d9aa900-1dee-4c8c-b7de-d9d3476b0f21): created successfully Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158a8a7b-596c-4382-9ee9-f87a0b1cee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Flow 'volume_create_manager' (a3e57ea4-88d1-4127-ab08-8576ad894798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-98a66180-9dcd-465f-a24d-52cf9363ed52 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created volume successfully. Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "cinder-0c077dc2-292a-40d5-9250-60015107a158-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-0c077dc2-292a-40d5-9250-60015107a158-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "cinder-quobyte-0c077dc2-292a-40d5-9250-60015107a158" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-quobyte-0c077dc2-292a-40d5-9250-60015107a158" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2050d7c6-94b9-453b-a494-960529a858d7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:41 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 1073741824" returned: 0 in 0.664s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2099d7f0-9cf7-495d-a91c-3d02bd64a400]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:42 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 Sep 01 11:35:42 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:42 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 Sep 01 11:35:42 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:42 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 Sep 01 11:35:42 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:42 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158" returned: 0 in 0.474s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:42 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0" returned: 0 in 0.384s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:42 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158 Sep 01 11:35:42 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674ee8ed-222b-4325-993a-9c33793f0d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1780422d-e64b-452b-acea-702c9255caf0', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74167983-3958-4dbb-8e43-b358b1bee555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Volume volume-1780422d-e64b-452b-acea-702c9255caf0 (1780422d-e64b-452b-acea-702c9255caf0): created successfully Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74167983-3958-4dbb-8e43-b358b1bee555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:42 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Flow 'volume_create_manager' (97ad8069-362d-4e79-b882-86ba772dccb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21" returned: 0 in 0.517s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-af25cda2-102b-464e-9118-59fd8d82e469 tempest-ProjectReaderTests-2021660792 None] Created volume successfully. Sep 01 11:35:42 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21 Sep 01 11:35:42 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:42 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0c077dc2-292a-40d5-9250-60015107a158" returned: 0 in 0.346s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-quobyte-0c077dc2-292a-40d5-9250-60015107a158" released by "delete_volume" :: held 0.878s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Created reservations ['40f4d0de-6440-4ef7-9596-715a41eaf3b2', 'ef8b9931-1563-45ee-8c70-a4889bb2ceac', '1b24d8c7-cce7-4926-9fd0-aa298adfa5d6', '3da5f5e2-fc77-44b9-8fb1-bfd881ccb876'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:42 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21" returned: 0 in 0.322s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21" released by "delete_volume" :: held 0.906s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['073d0264-6400-4fad-8242-aa40795615d0', '33bd5d99-04fe-472b-b834-9f2dc3c0746b', 'c2fe995a-0672-4be4-bb78-d3b9814d7a0a', 'd3891c26-5777-4617-94fd-be738de17729'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:42 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:42 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "cinder-ab18a4c5-509e-483d-af43-9265fdb9a488-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:43 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:43 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-ab18a4c5-509e-483d-af43-9265fdb9a488-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "cinder-quobyte-ab18a4c5-509e-483d-af43-9265fdb9a488" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-quobyte-ab18a4c5-509e-483d-af43-9265fdb9a488" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acd3a6-36f9-4ddd-97ce-7f7bff4187bc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:43 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.375s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Deleted volume successfully. Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5d99844b-fee2-426d-8d36-12e1ed25498f tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-0c077dc2-292a-40d5-9250-60015107a158-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:43 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 Sep 01 11:35:43 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:43 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.423s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleted volume successfully. Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24345bd3-41dd-4c64-9fa8-c19892aecd60 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-7d9aa900-1dee-4c8c-b7de-d9d3476b0f21-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Acquiring lock "cinder-1780422d-e64b-452b-acea-702c9255caf0-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Lock "cinder-1780422d-e64b-452b-acea-702c9255caf0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Flow 'volume_create_manager' (f6547840-7119-4f63-bf7c-43b2b8186c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b492da80-ff61-43ca-b83a-3733b036e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b492da80-ff61-43ca-b83a-3733b036e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1670289387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b641211-1d8c-49dc-9394-9de1f4e97529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c6a457dc644ce09094e29a5ed29fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:44Z,use_quota=True,user_id='a20a769889894517ba5f7367c2e653cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acd77d9-e402-4708-adfd-a11bd190ccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acd77d9-e402-4708-adfd-a11bd190ccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e630983-62c3-46ca-bfad-b481932a1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e630983-62c3-46ca-bfad-b481932a1841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b641211-1d8c-49dc-9394-9de1f4e97529', 'volume_name': 'volume-0b641211-1d8c-49dc-9394-9de1f4e97529', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc33dee9-d340-493f-9068-696be831c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc33dee9-d340-493f-9068-696be831c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85aeb5a-e06d-42be-a279-9e51485d7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Volume 0b641211-1d8c-49dc-9394-9de1f4e97529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b641211-1d8c-49dc-9394-9de1f4e97529', 'volume_size': 1} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1670289387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b641211-1d8c-49dc-9394-9de1f4e97529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c6a457dc644ce09094e29a5ed29fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:44Z,use_quota=True,user_id='a20a769889894517ba5f7367c2e653cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Creating volume 0b641211-1d8c-49dc-9394-9de1f4e97529 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:43 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:43 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488" returned: 0 in 0.553s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:43 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 1073741824 Sep 01 11:35:43 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Acquiring lock "cinder-quobyte-1780422d-e64b-452b-acea-702c9255caf0" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:43 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488 Sep 01 11:35:43 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Lock "cinder-quobyte-1780422d-e64b-452b-acea-702c9255caf0" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[86533d95-76a2-4150-9208-c2bc2a116ae7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:43 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 Sep 01 11:35:43 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:44 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ab18a4c5-509e-483d-af43-9265fdb9a488" returned: 0 in 0.316s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-quobyte-ab18a4c5-509e-483d-af43-9265fdb9a488" released by "delete_volume" :: held 0.923s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Created reservations ['1813147f-7a2e-449f-9d84-b26e5c81d111', 'd6333ca3-4ae3-4507-85d2-a0251ca237cc', 'b88cc84d-9fdd-4780-9a2d-bcd1c90a757f', '9ff54e6b-49a5-40ae-a61f-79950c60f0bb'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9cbd2-23f4-411d-aa03-daa3a7502f2a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:44 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 1073741824" returned: 0 in 0.554s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0" returned: 0 in 0.476s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:44 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0 Sep 01 11:35:44 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:44 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 Sep 01 11:35:44 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:44 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 Sep 01 11:35:44 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:44 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:44 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:44 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1780422d-e64b-452b-acea-702c9255caf0" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Lock "cinder-quobyte-1780422d-e64b-452b-acea-702c9255caf0" released by "delete_volume" :: held 0.803s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Created reservations ['466793b6-b51b-4ab9-a097-aaf6d0c528f5', '8b24ff03-3ec0-463f-bfbb-66553f3cb3f8', '80a3f968-115d-4265-92dc-fffdf47f7c68', '20a13781-9fe1-47e6-bcdf-0570efdf5c98'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:44 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529" returned: 0 in 0.305s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85aeb5a-e06d-42be-a279-9e51485d7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b641211-1d8c-49dc-9394-9de1f4e97529', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0af1fff-20c8-4c0d-8fbd-a2bd0a606e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Volume volume-0b641211-1d8c-49dc-9394-9de1f4e97529 (0b641211-1d8c-49dc-9394-9de1f4e97529): created successfully Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0af1fff-20c8-4c0d-8fbd-a2bd0a606e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:44 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Flow 'volume_create_manager' (f6547840-7119-4f63-bf7c-43b2b8186c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:44 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.404s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40" returned: 0 in 0.492s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Deleted volume successfully. Sep 01 11:35:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8f4989cb-a6be-41c9-9dd3-4d8af633f48c tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Created volume successfully. Sep 01 11:35:44 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40 Sep 01 11:35:44 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a2bd459c-eb53-4632-be21-e30999e0896e tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-ab18a4c5-509e-483d-af43-9265fdb9a488-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:44 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:44 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:45 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40" returned: 0 in 0.272s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40" released by "delete_volume" :: held 0.823s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:45 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['89a6ef01-7a0a-4495-a51b-58ecf53682d9', 'fbd44eef-938b-480e-8bb6-d485bc2675e6', 'e913659a-6b34-409e-847c-cae87d537738', 'af72e759-e275-40b5-9245-b9e3535ff317'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Deleted volume successfully. Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1f3c4e07-9f31-4860-82b2-35bff4bba1cb tempest-ProjectReaderTests-2021660792 None] Lock "cinder-1780422d-e64b-452b-acea-702c9255caf0-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:45 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:45 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-e4a907f3-c174-4436-ba2d-d905edf185dc-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-e4a907f3-c174-4436-ba2d-d905edf185dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-e4a907f3-c174-4436-ba2d-d905edf185dc" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-e4a907f3-c174-4436-ba2d-d905edf185dc" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6033b04-302c-4942-8383-aa377251b950]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "cinder-67445399-0c51-4e04-b98f-1d72a736929f-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-67445399-0c51-4e04-b98f-1d72a736929f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:45 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.381s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "cinder-quobyte-67445399-0c51-4e04-b98f-1d72a736929f" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleted volume successfully. Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-quobyte-67445399-0c51-4e04-b98f-1d72a736929f" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:45 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc Sep 01 11:35:45 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40ccdc8b-03ff-4244-b2f6-343f4e4709a3 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-f7b8f10b-b08e-48fe-9aa3-102f7a88ea40-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5af968f-a0bf-4e61-8d4b-1a143fea2925]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:45 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f Sep 01 11:35:45 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:45 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc" returned: 0 in 0.510s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:46 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc Sep 01 11:35:46 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:46 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f" returned: 0 in 0.474s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:46 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f Sep 01 11:35:46 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:46 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e4a907f3-c174-4436-ba2d-d905edf185dc" returned: 0 in 0.330s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-e4a907f3-c174-4436-ba2d-d905edf185dc" released by "delete_volume" :: held 0.898s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['8a73863e-c343-4efe-b154-333f72e516cc', '80f94cfb-78bf-45a1-a3ad-6f87db2ff38b', '198ec1ff-4bcc-491d-8b37-bae6a5e60a8f', '0ff5cf3e-46e1-4985-a6ed-572bc2828551'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:46 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-67445399-0c51-4e04-b98f-1d72a736929f" returned: 0 in 0.350s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-quobyte-67445399-0c51-4e04-b98f-1d72a736929f" released by "delete_volume" :: held 0.889s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:46 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:46 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Created reservations ['c26243f5-a455-42a6-9585-96e86f19d351', '82239e80-c6e4-4f11-93b4-460f58a4079d', 'e1e60a2b-b404-4033-973a-efeaf9af36e8', 'e26a57d2-5cbd-4293-8211-5b90c660f92b'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:46 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:46 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:46 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleted volume successfully. Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-769b954a-2e81-4898-93c5-1ea36e76a11a tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-e4a907f3-c174-4436-ba2d-d905edf185dc-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f5267-7020-4621-80a0-02f2a5cf0157]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:47 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Deleted volume successfully. Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98244f94-6686-4876-858c-81e5642bdb89 tempest-VolumesListTestJSON-2095576423 None] Lock "cinder-67445399-0c51-4e04-b98f-1d72a736929f-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:47 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 Sep 01 11:35:47 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:47 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529" returned: 0 in 0.385s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.406s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-0b641211-1d8c-49dc-9394-9de1f4e97529', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '041f3cd8-acab-4081-9bdc-2e03d60a0bc0', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:35:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-5972502b-e67c-4032-be2c-3ad4c2da3ede req-1a3e47f5-da19-410c-9ab4-49bb90d78fb8 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] attachment_update completed successfully. Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-190afc3a-7a7a-40ef-b325-e639662e4b34-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-190afc3a-7a7a-40ef-b325-e639662e4b34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-190afc3a-7a7a-40ef-b325-e639662e4b34" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-190afc3a-7a7a-40ef-b325-e639662e4b34" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ebdb1a-dfab-401b-a7ab-c2bb325c744c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:47 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 Sep 01 11:35:47 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:48 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34" returned: 0 in 0.502s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:48 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34 Sep 01 11:35:48 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:48 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-190afc3a-7a7a-40ef-b325-e639662e4b34" returned: 0 in 0.379s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-190afc3a-7a7a-40ef-b325-e639662e4b34" released by "delete_volume" :: held 0.957s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['403523a0-a220-4df9-b932-81177132a500', '4e4b3805-6ffd-4468-b1a3-476103cafd5e', '1dd8fc73-0781-4410-9c99-c9bbe8ae7ecf', '4f75f40b-057a-4abc-96ca-3d33d0f102d2'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:48 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:48 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:49 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:49 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleted volume successfully. Sep 01 11:35:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ebdea5ea-e065-464c-8444-3e285c7bd8ce tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-190afc3a-7a7a-40ef-b325-e639662e4b34-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-a6a3d603-0a53-43f2-97e3-f9793307b4f9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-a6a3d603-0a53-43f2-97e3-f9793307b4f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-a6a3d603-0a53-43f2-97e3-f9793307b4f9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-a6a3d603-0a53-43f2-97e3-f9793307b4f9" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7f1c4c-da38-4c63-beee-ce5225993d93]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:50 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 Sep 01 11:35:50 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:50 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9" returned: 0 in 0.513s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:50 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9 Sep 01 11:35:50 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:50 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6a3d603-0a53-43f2-97e3-f9793307b4f9" returned: 0 in 0.329s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-a6a3d603-0a53-43f2-97e3-f9793307b4f9" released by "delete_volume" :: held 0.926s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-36d8ba89-167c-4bf9-8f78-a74a930a767a req-cfe283b0-09a6-4f13-8be0-ab9180e94e14 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Terminate volume connection completed successfully. Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-36d8ba89-167c-4bf9-8f78-a74a930a767a req-cfe283b0-09a6-4f13-8be0-ab9180e94e14 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Deleting attachment 041f3cd8-acab-4081-9bdc-2e03d60a0bc0. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['a47d6bc1-e7f3-4c80-a693-bd833fd0e381', '2bfa3cba-8c70-49ec-b64f-19720261d472', '1bb97cba-66bb-4943-be24-e987fabd2457', '3c2f4001-7ab8-4622-b6f8-c361c78ef06e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:51 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:51 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-8434e9af-ac4d-4019-a2ff-101d2d704e5d-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-8434e9af-ac4d-4019-a2ff-101d2d704e5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-a5676a90-f87a-4786-9a70-6f7e4d040dd0" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-a5676a90-f87a-4786-9a70-6f7e4d040dd0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-8434e9af-ac4d-4019-a2ff-101d2d704e5d" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-8434e9af-ac4d-4019-a2ff-101d2d704e5d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleting offline snapshot 8434e9af-ac4d-4019-a2ff-101d2d704e5d of volume a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] snapshot_file for this snap is: volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a04cb7-921e-42bf-8801-e9b12b96d8bd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:51 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.341s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleted volume successfully. Sep 01 11:35:51 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d Sep 01 11:35:51 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-62c7f0d7-4e3f-49a5-90c7-31375ad7ca93 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-a6a3d603-0a53-43f2-97e3-f9793307b4f9-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Flow 'volume_create_manager' (aa34da77-8eb5-4772-9441-165097d259fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2517346a-127c-43a1-a98c-f77c98f1d603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2517346a-127c-43a1-a98c-f77c98f1d603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-298315780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e478c97a-fa2f-4c75-9195-f6b5971e15fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7989f1d712247bd8b794896f9d175e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:52Z,use_quota=True,user_id='dc982202987340d78b9a45b30ca92ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6188b2d9-c42c-4dbb-b441-e28d5ea677bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6188b2d9-c42c-4dbb-b441-e28d5ea677bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2507976d-775c-407b-8bab-efb81ebda20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2507976d-775c-407b-8bab-efb81ebda20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e478c97a-fa2f-4c75-9195-f6b5971e15fc', 'volume_name': 'volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbbbf83-995e-4100-a368-f2bd3e77b71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbbbf83-995e-4100-a368-f2bd3e77b71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de70db00-1142-41de-95c2-6d85bf0cd6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:51 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Volume e478c97a-fa2f-4c75-9195-f6b5971e15fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc', 'volume_size': 1} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-298315780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e478c97a-fa2f-4c75-9195-f6b5971e15fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7989f1d712247bd8b794896f9d175e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:35:52Z,use_quota=True,user_id='dc982202987340d78b9a45b30ca92ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Creating volume e478c97a-fa2f-4c75-9195-f6b5971e15fc {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:35:51 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:51 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc 1073741824 Sep 01 11:35:51 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Acquiring lock "cinder-0b641211-1d8c-49dc-9394-9de1f4e97529-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "cinder-0b641211-1d8c-49dc-9394-9de1f4e97529-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Acquiring lock "cinder-quobyte-0b641211-1d8c-49dc-9394-9de1f4e97529" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "cinder-quobyte-0b641211-1d8c-49dc-9394-9de1f4e97529" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:51 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d" returned: 0 in 0.643s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e1b05-00cb-404b-808e-8e2b89281fd9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe536e28-795b-4fd5-9b30-2ae89e17d498]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:52 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 Sep 01 11:35:52 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:52 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 Sep 01 11:35:52 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:52 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc 1073741824" returned: 0 in 0.604s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:52 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0" returned: 0 in 0.446s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:52 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:52 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529" returned: 0 in 0.498s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:52 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:52 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d Sep 01 11:35:52 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:52 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529 Sep 01 11:35:52 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:52 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:35:52 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0b641211-1d8c-49dc-9394-9de1f4e97529" returned: 0 in 0.351s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "cinder-quobyte-0b641211-1d8c-49dc-9394-9de1f4e97529" released by "delete_volume" :: held 0.913s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de70db00-1142-41de-95c2-6d85bf0cd6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e908e927-9a19-418d-b55c-7c778851165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:35:52 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Volume volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc (e478c97a-fa2f-4c75-9195-f6b5971e15fc): created successfully Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e908e927-9a19-418d-b55c-7c778851165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Flow 'volume_create_manager' (aa34da77-8eb5-4772-9441-165097d259fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:35:52 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6fc6a5aa-eeed-41ba-a028-413e4b753bd0 tempest-VolumesNegativeTest-1518281781 None] Created volume successfully. Sep 01 11:35:52 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Created reservations ['3a725d22-c2b6-4d4f-b8c5-0b6c677d41de', '655a15a6-a9ae-4d7a-8b20-6b174ad4bd55', '0e93bfca-49a1-4686-bdd3-51a8432732f7', '5ab3f5ff-f8c0-412e-8f44-ccd882e44069'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:53 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d" returned: 0 in 0.520s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:53 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d Sep 01 11:35:53 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:53 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:53 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:53 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0.8434e9af-ac4d-4019-a2ff-101d2d704e5d" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-8434e9af-ac4d-4019-a2ff-101d2d704e5d" released by "_delete_snapshot" :: held 2.013s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:53 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-a5676a90-f87a-4786-9a70-6f7e4d040dd0" released by "delete_snapshot" :: held 2.047s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Deleted volume successfully. Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-816bb268-0c2f-4eb9-a25c-75a5adf0c8f5 tempest-TestServerVolumeAttachScenarioOldVersion-1862891536 None] Lock "cinder-0b641211-1d8c-49dc-9394-9de1f4e97529-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['50ee54c2-639d-46e2-a397-ddf540bffdc2', 'f5830e56-d240-49ef-b79a-2fbd44270f7e', '728cc65a-0e26-4fff-bcba-c826d5594f41', '0f0b6c0e-1c5d-43c4-b7c0-7d1c419ed043'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Delete snapshot completed successfully. Sep 01 11:35:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fe847f07-5e97-4ae9-b361-018f4e1b38ba tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-8434e9af-ac4d-4019-a2ff-101d2d704e5d-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-a5676a90-f87a-4786-9a70-6f7e4d040dd0-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-a5676a90-f87a-4786-9a70-6f7e4d040dd0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "cinder-quobyte-a5676a90-f87a-4786-9a70-6f7e4d040dd0" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:35:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-a5676a90-f87a-4786-9a70-6f7e4d040dd0" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:35:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[be78667d-f1bc-4a94-8987-3490dbe36302]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:35:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:54 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 Sep 01 11:35:54 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:55 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0" returned: 0 in 0.544s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:55 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0 Sep 01 11:35:55 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:55 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a5676a90-f87a-4786-9a70-6f7e4d040dd0" returned: 0 in 0.428s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-quobyte-a5676a90-f87a-4786-9a70-6f7e4d040dd0" released by "delete_volume" :: held 1.107s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Created reservations ['a95ea0cc-bdf9-42c7-bb83-82f1b51aceee', 'dfb045e5-8177-48d6-b3ed-a7a86e02bcc0', '190def8d-85de-4bbd-b80e-bc836ce5f1a7', 'dca3c662-6b19-4539-b9a8-281ba610ada7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:35:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:35:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:35:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:35:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:35:56 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:35:56 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:35:56 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 01 11:35:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.513s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:35:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:35:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Deleted volume successfully. Sep 01 11:35:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-49427ecc-080d-44a9-ab63-0f0dcfa728e7 tempest-CreateVolumesFromSnapshotTest-608291781 None] Lock "cinder-a5676a90-f87a-4786-9a70-6f7e4d040dd0-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (ca0c10f3-9d53-4ad7-a1b7-3b9706560e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc53e210-9e9a-410f-99cb-2b37530212fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc53e210-9e9a-410f-99cb-2b37530212fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319681560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97954117-8c1d-4576-aeb1-13ae4d622c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:04Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daa2237-35d0-4a82-823e-1860f28a69c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daa2237-35d0-4a82-823e-1860f28a69c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c56cdc7-5bd9-42f4-89ef-a0cdf0d5ae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c56cdc7-5bd9-42f4-89ef-a0cdf0d5ae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97954117-8c1d-4576-aeb1-13ae4d622c4f', 'volume_name': 'volume-97954117-8c1d-4576-aeb1-13ae4d622c4f', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a694a3-7a53-45e9-bd49-79f5af593db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a694a3-7a53-45e9-bd49-79f5af593db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c4b256-036f-415b-a4b6-f78995c1b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:03 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume 97954117-8c1d-4576-aeb1-13ae4d622c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97954117-8c1d-4576-aeb1-13ae4d622c4f', 'volume_size': 1} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319681560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97954117-8c1d-4576-aeb1-13ae4d622c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:04Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Creating volume 97954117-8c1d-4576-aeb1-13ae4d622c4f {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:03 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:03 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f 1073741824 Sep 01 11:36:03 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:04 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f 1073741824" returned: 0 in 0.761s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:04 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f Sep 01 11:36:04 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:04 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:04 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (08ff4a2a-4cf0-425a-a243-5bc00ba9bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3e7ada-3204-402d-89b3-0adc79f12766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3e7ada-3204-402d-89b3-0adc79f12766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373224791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349e8c16-7a2c-408c-8a9b-63c9b45cc2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:05Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca686199-eb0e-42b2-bad3-afc7a33aff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca686199-eb0e-42b2-bad3-afc7a33aff27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e23b87b-6917-481f-977c-06facb334713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e23b87b-6917-481f-977c-06facb334713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349e8c16-7a2c-408c-8a9b-63c9b45cc2f6', 'volume_name': 'volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f84716f-ebd9-4c98-9fa5-5aa705818b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f84716f-ebd9-4c98-9fa5-5aa705818b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3c5b92-140e-42d8-8865-3ae060e5d0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:04 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Volume 349e8c16-7a2c-408c-8a9b-63c9b45cc2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6', 'volume_size': 1} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:04 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f" returned: 0 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373224791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349e8c16-7a2c-408c-8a9b-63c9b45cc2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:05Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Creating volume 349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:04 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c4b256-036f-415b-a4b6-f78995c1b03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97954117-8c1d-4576-aeb1-13ae4d622c4f', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f31a9f8-b95d-47fc-8def-61632f899318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:05 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 1073741824 Sep 01 11:36:05 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:05 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume volume-97954117-8c1d-4576-aeb1-13ae4d622c4f (97954117-8c1d-4576-aeb1-13ae4d622c4f): created successfully Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f31a9f8-b95d-47fc-8def-61632f899318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (ca0c10f3-9d53-4ad7-a1b7-3b9706560e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ada18df8-b0a9-4e25-a3ab-9337fb47e384 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created volume successfully. Sep 01 11:36:05 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.578s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:36:05 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 1073741824" returned: 0 in 0.783s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:05 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 Sep 01 11:36:05 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:06 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6" returned: 0 in 0.519s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3c5b92-140e-42d8-8865-3ae060e5d0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d28605-3241-408b-b729-fbd782aeae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:06 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Volume volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 (349e8c16-7a2c-408c-8a9b-63c9b45cc2f6): created successfully Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d28605-3241-408b-b729-fbd782aeae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (08ff4a2a-4cf0-425a-a243-5bc00ba9bddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9af4e56c-6097-462e-9525-4d33190dff6f tempest-ProjectReaderTests-668839877 None] Created volume successfully. Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (49b088c1-d093-4de3-a51a-aaecc869c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14292367-62a8-4cf4-bde7-ca68c97b2118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14292367-62a8-4cf4-bde7-ca68c97b2118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167679052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1002ca6c-cefc-4b2a-98bf-0d60fba25894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:07Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78173ce-80fe-47e0-94d6-4a880caec253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78173ce-80fe-47e0-94d6-4a880caec253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4b4a5b-aad8-40af-8c9a-345fd74bf31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4b4a5b-aad8-40af-8c9a-345fd74bf31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1002ca6c-cefc-4b2a-98bf-0d60fba25894', 'volume_name': 'volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe4dbdb-79e5-4ffe-9287-273d29daad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe4dbdb-79e5-4ffe-9287-273d29daad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c0aa3e-ffed-46f3-a42f-e2cc387866cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:06 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume 1002ca6c-cefc-4b2a-98bf-0d60fba25894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894', 'volume_size': 1} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167679052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1002ca6c-cefc-4b2a-98bf-0d60fba25894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:07Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Creating volume 1002ca6c-cefc-4b2a-98bf-0d60fba25894 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:06 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:06 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 1073741824 Sep 01 11:36:06 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Lock "cinder-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-quobyte-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (a2b492af-03ac-47be-b18e-cecce0128b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7a766c-aa4b-4751-a04e-99682128a224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7a766c-aa4b-4751-a04e-99682128a224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1343007297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64982822-9e65-482d-b8d6-5353e89e2f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:07Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783d2d9-40c6-416b-9b43-f6c155846f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783d2d9-40c6-416b-9b43-f6c155846f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d04472-9c93-41ee-b1f2-fe24e67e6c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d04472-9c93-41ee-b1f2-fe24e67e6c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64982822-9e65-482d-b8d6-5353e89e2f0d', 'volume_name': 'volume-64982822-9e65-482d-b8d6-5353e89e2f0d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bea270-e27e-4898-a559-5025baa02b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bea270-e27e-4898-a559-5025baa02b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7d89a8-c609-49e7-88cd-3abcbeb1cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:07 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume 64982822-9e65-482d-b8d6-5353e89e2f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64982822-9e65-482d-b8d6-5353e89e2f0d', 'volume_size': 1} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6" acquired by "delete_volume" :: waited 0.121s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d79472-76d3-4052-9757-54595f4fad58]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:07 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 Sep 01 11:36:07 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:07 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 1073741824" returned: 0 in 0.814s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:07 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 Sep 01 11:36:07 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:07 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6" returned: 0 in 0.662s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:08 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6 Sep 01 11:36:08 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:08 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894" returned: 0 in 0.600s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1343007297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64982822-9e65-482d-b8d6-5353e89e2f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:07Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Creating volume 64982822-9e65-482d-b8d6-5353e89e2f0d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:08 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:08 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d 1073741824 Sep 01 11:36:08 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c0aa3e-ffed-46f3-a42f-e2cc387866cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a95037-d2c8-490d-80da-ebdce03332be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (c1d3a00b-bdbb-439d-8d02-118faa83a84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe14653-5c2e-4beb-9ad1-dd9875d459f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 (1002ca6c-cefc-4b2a-98bf-0d60fba25894): created successfully Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a95037-d2c8-490d-80da-ebdce03332be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (49b088c1-d093-4de3-a51a-aaecc869c08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (95ca9187-f3c6-431a-bbf0-681da5b95264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef953dd5-4475-4bd1-851f-7c9079464cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe14653-5c2e-4beb-9ad1-dd9875d459f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331318182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efef213c-83bc-44f1-90e0-a53cb222b3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:08Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9757e7-8c71-4e52-a166-c427fc2cb8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9757e7-8c71-4e52-a166-c427fc2cb8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db038f9-e5b8-46e6-8962-4fe182fe4318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db038f9-e5b8-46e6-8962-4fe182fe4318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efef213c-83bc-44f1-90e0-a53cb222b3dd', 'volume_name': 'volume-efef213c-83bc-44f1-90e0-a53cb222b3dd', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0368d9e1-884d-4601-82ab-133e0b991e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0368d9e1-884d-4601-82ab-133e0b991e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a8058c-df85-4a25-b66e-391f3566c698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume efef213c-83bc-44f1-90e0-a53cb222b3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efef213c-83bc-44f1-90e0-a53cb222b3dd', 'volume_size': 1} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5d69856c-da67-4d17-b0b1-f87a9058fb1b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created volume successfully. Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef953dd5-4475-4bd1-851f-7c9079464cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147627445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e0b2c-ec38-4d23-8437-32667afc0734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:08Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a04142-470b-46b7-a599-a82f22f87f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a04142-470b-46b7-a599-a82f22f87f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062fe2c8-58e6-4a7e-9ad3-a33ba523042d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062fe2c8-58e6-4a7e-9ad3-a33ba523042d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83e0b2c-ec38-4d23-8437-32667afc0734', 'volume_name': 'volume-e83e0b2c-ec38-4d23-8437-32667afc0734', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5b292f-72e4-4a3c-8426-11190d9998f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5b292f-72e4-4a3c-8426-11190d9998f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6486647-b626-4c61-915d-585feb87cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume e83e0b2c-ec38-4d23-8437-32667afc0734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83e0b2c-ec38-4d23-8437-32667afc0734', 'volume_size': 1} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6" returned: 0 in 0.812s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6" released by "delete_volume" :: held 1.535s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:08 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Created reservations ['57478fe3-8ff5-4463-bc1c-f58934b0f1c7', '1e7dd62d-503b-41bc-bbb6-43de6500cc53', '81eb9d08-566d-4e3b-aa7b-92157170ec5c', 'a79d9a4d-7f72-4502-82ef-81c6e020b2a8'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:09 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:09 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:09 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (cc6d7bf5-df91-452b-9095-c89aafb4cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9d9c91-c42f-4750-8122-bd506ea395e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d 1073741824" returned: 0 in 0.912s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9d9c91-c42f-4750-8122-bd506ea395e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065903392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4fc9d3-f504-4da0-b7db-577e25bebea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:09Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f02817-0d54-4229-9fbd-6e83cbeddfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f02817-0d54-4229-9fbd-6e83cbeddfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0ecf0f-33d5-446d-9c2c-6e9abb6acdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0ecf0f-33d5-446d-9c2c-6e9abb6acdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4fc9d3-f504-4da0-b7db-577e25bebea9', 'volume_name': 'volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35944e7-60f1-48e2-b498-08b4d4a96c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35944e7-60f1-48e2-b498-08b4d4a96c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c391acef-cc44-4e8f-a4d9-a587c17e22b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:09 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume fb4fc9d3-f504-4da0-b7db-577e25bebea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9', 'volume_size': 1} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:09 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d Sep 01 11:36:09 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:09 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.444s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Deleted volume successfully. Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6d842200-afc3-4272-9d58-5b3e63054d55 tempest-ProjectReaderTests-668839877 None] Lock "cinder-349e8c16-7a2c-408c-8a9b-63c9b45cc2f6-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:09 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331318182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efef213c-83bc-44f1-90e0-a53cb222b3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:08Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Creating volume efef213c-83bc-44f1-90e0-a53cb222b3dd {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:09 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:09 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd 1073741824 Sep 01 11:36:09 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7d89a8-c609-49e7-88cd-3abcbeb1cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64982822-9e65-482d-b8d6-5353e89e2f0d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4863a354-efb4-4936-940d-26bee21c3654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:09 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume volume-64982822-9e65-482d-b8d6-5353e89e2f0d (64982822-9e65-482d-b8d6-5353e89e2f0d): created successfully Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4863a354-efb4-4936-940d-26bee21c3654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (a2b492af-03ac-47be-b18e-cecce0128b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:09 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8cbc4264-75ca-4db6-bbfe-7ed9c62f4250 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created volume successfully. Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (83acfac0-3639-4911-8f6d-c7e47309f557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3274c5a-f510-4d02-a4ae-8fdc400e873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3274c5a-f510-4d02-a4ae-8fdc400e873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585756286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:10Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b36025-eac9-4703-8fb1-2f290ff5d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b36025-eac9-4703-8fb1-2f290ff5d32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e8df0-79d2-4293-9cdf-be5624b2033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e8df0-79d2-4293-9cdf-be5624b2033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c', 'volume_name': 'volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1059afc8-d31c-41e1-a6b3-518a271b9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1059afc8-d31c-41e1-a6b3-518a271b9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7eee69-3b0c-4527-aed3-9c1801f98c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:10 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Volume ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c', 'volume_size': 1} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:10 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd 1073741824" returned: 0 in 0.692s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:10 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd Sep 01 11:36:10 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:10 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd" returned: 0 in 0.300s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147627445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e0b2c-ec38-4d23-8437-32667afc0734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:08Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Creating volume e83e0b2c-ec38-4d23-8437-32667afc0734 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:10 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:10 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 1073741824 Sep 01 11:36:10 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a8058c-df85-4a25-b66e-391f3566c698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efef213c-83bc-44f1-90e0-a53cb222b3dd', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b3f2e5-a9f3-46e3-a2a8-db620bbac14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:10 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume volume-efef213c-83bc-44f1-90e0-a53cb222b3dd (efef213c-83bc-44f1-90e0-a53cb222b3dd): created successfully Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b3f2e5-a9f3-46e3-a2a8-db620bbac14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (c1d3a00b-bdbb-439d-8d02-118faa83a84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-30b1e7dd-01d8-46a3-b97c-75a74cf2c289 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created volume successfully. Sep 01 11:36:11 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 1073741824" returned: 0 in 0.559s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:11 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 Sep 01 11:36:11 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:11 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.352s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065903392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4fc9d3-f504-4da0-b7db-577e25bebea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5374f6d88b645bd841acfb2da058a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:09Z,use_quota=True,user_id='8596772f37a74660b3aa40451c7a054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Creating volume fb4fc9d3-f504-4da0-b7db-577e25bebea9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:11 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6486647-b626-4c61-915d-585feb87cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83e0b2c-ec38-4d23-8437-32667afc0734', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:11 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 1073741824 Sep 01 11:36:11 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053a0b7b-b7b9-4734-8e44-7716994d3a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:11 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume volume-e83e0b2c-ec38-4d23-8437-32667afc0734 (e83e0b2c-ec38-4d23-8437-32667afc0734): created successfully Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053a0b7b-b7b9-4734-8e44-7716994d3a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (95ca9187-f3c6-431a-bbf0-681da5b95264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-cfaa353c-a09b-452b-a888-b4ddbc9ed31e tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created volume successfully. Sep 01 11:36:12 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 1073741824" returned: 0 in 0.531s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:12 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 Sep 01 11:36:12 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:12 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.277s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585756286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:10Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Creating volume ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:12 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:12 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c 1073741824 Sep 01 11:36:12 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c391acef-cc44-4e8f-a4d9-a587c17e22b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd70fb5-825c-4d7f-a2d9-0ebd7637af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:12 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Volume volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 (fb4fc9d3-f504-4da0-b7db-577e25bebea9): created successfully Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd70fb5-825c-4d7f-a2d9-0ebd7637af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Flow 'volume_create_manager' (cc6d7bf5-df91-452b-9095-c89aafb4cef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5fad242b-00d5-4eb9-b93d-e89ca6c40a9b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created volume successfully. Sep 01 11:36:13 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c 1073741824" returned: 0 in 0.508s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:13 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c Sep 01 11:36:13 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:13 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c" returned: 0 in 0.249s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7eee69-3b0c-4527-aed3-9c1801f98c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65917af-b32f-4eba-9f22-a27c3708b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:13 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Volume volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c (ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c): created successfully Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65917af-b32f-4eba-9f22-a27c3708b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (83acfac0-3639-4911-8f6d-c7e47309f557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c4831440-308d-4445-9d09-206a59484db6 tempest-ProjectReaderTests-668839877 None] Created volume successfully. Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-fb4fc9d3-f504-4da0-b7db-577e25bebea9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-fb4fc9d3-f504-4da0-b7db-577e25bebea9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-quobyte-fb4fc9d3-f504-4da0-b7db-577e25bebea9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-fb4fc9d3-f504-4da0-b7db-577e25bebea9" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11e72a-e099-4359-a99f-ab18833d487e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:14 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 Sep 01 11:36:14 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:14 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9" returned: 0 in 0.421s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:14 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9 Sep 01 11:36:14 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Lock "cinder-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-quobyte-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728a1b4-8eb2-4079-b678-b4cec73f3076]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:14 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-fb4fc9d3-f504-4da0-b7db-577e25bebea9" returned: 0 in 0.388s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-fb4fc9d3-f504-4da0-b7db-577e25bebea9" released by "delete_volume" :: held 0.879s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:14 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created reservations ['08d7f59b-5fc7-40f3-a506-9a57c144ed4c', '74a3b7f6-eff2-49ab-a090-1e5c535c7b3e', '2945f591-fd51-4031-8fb4-d826354ed53f', '09ed20c5-a28a-4238-b8f9-3599e7b9e4fd'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:14 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c Sep 01 11:36:14 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:15 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:15 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-efef213c-83bc-44f1-90e0-a53cb222b3dd-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-efef213c-83bc-44f1-90e0-a53cb222b3dd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-quobyte-efef213c-83bc-44f1-90e0-a53cb222b3dd" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-efef213c-83bc-44f1-90e0-a53cb222b3dd" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b69276e-f3ac-4cac-8251-c03856ceca68]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:15 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c" returned: 0 in 0.640s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:15 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c Sep 01 11:36:15 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:15 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.412s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Deleted volume successfully. Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-42c7e96c-8348-4cee-ae1f-3dbe2ef7dbad tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-fb4fc9d3-f504-4da0-b7db-577e25bebea9-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:15 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd Sep 01 11:36:15 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:15 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c" returned: 0 in 0.391s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c" released by "delete_volume" :: held 1.082s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Created reservations ['05f9c9f1-2e40-49dc-895b-645245e7633b', 'df7205fc-a6f3-464f-9070-51f146314a78', '2ab812cb-ad98-4e64-a1e7-767b130e2299', 'e8aa25f9-bb15-4a4c-bc5a-69a175680bce'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:15 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd" returned: 0 in 0.513s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:15 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd Sep 01 11:36:15 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:16 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:16 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:16 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-efef213c-83bc-44f1-90e0-a53cb222b3dd" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-efef213c-83bc-44f1-90e0-a53cb222b3dd" released by "delete_volume" :: held 0.881s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:16 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created reservations ['c5dc49fc-37d0-4fe3-a740-22ae0bff0420', '33ab8a55-03eb-4beb-ab6c-c1a748734433', 'b326a469-6b37-4931-a1ca-1955da6f9dce', 'db6fe660-e57c-4645-9da3-72a1b1e38c4d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Deleted volume successfully. Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-97b560d6-bc0c-407c-911c-ad6875a03e6a tempest-ProjectReaderTests-668839877 None] Lock "cinder-ce7e26d6-eb12-4b39-81ae-c3f8ef7fb64c-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:16 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:16 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:16 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.318s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Deleted volume successfully. Sep 01 11:36:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d20520c8-19a7-45f1-9302-fe058bd9fa56 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-efef213c-83bc-44f1-90e0-a53cb222b3dd-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-e83e0b2c-ec38-4d23-8437-32667afc0734-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-e83e0b2c-ec38-4d23-8437-32667afc0734-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-quobyte-e83e0b2c-ec38-4d23-8437-32667afc0734" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-e83e0b2c-ec38-4d23-8437-32667afc0734" acquired by "delete_volume" :: waited 0.055s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (8b68da16-06ba-4618-ae79-38b5d77b90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f92be9a-e4e3-49af-8d18-8d4f7ee13c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce65028-8c0c-463d-bb10-ac981b9e4c6d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f92be9a-e4e3-49af-8d18-8d4f7ee13c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505537488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5341eb40-9684-4505-b569-fead0aa15d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:18Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863956e-d71f-4124-98a3-d227e81f1132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863956e-d71f-4124-98a3-d227e81f1132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87930a46-b5dc-43ed-84d5-522954427389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87930a46-b5dc-43ed-84d5-522954427389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5341eb40-9684-4505-b569-fead0aa15d71', 'volume_name': 'volume-5341eb40-9684-4505-b569-fead0aa15d71', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486b5bb2-c815-4208-811a-06db44ff13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486b5bb2-c815-4208-811a-06db44ff13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9513af-0000-4753-ac0e-5357f230632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Volume 5341eb40-9684-4505-b569-fead0aa15d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5341eb40-9684-4505-b569-fead0aa15d71', 'volume_size': 1} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505537488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5341eb40-9684-4505-b569-fead0aa15d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:18Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Creating volume 5341eb40-9684-4505-b569-fead0aa15d71 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:17 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:17 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 1073741824 Sep 01 11:36:17 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:17 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 Sep 01 11:36:17 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Acquiring lock "cinder-e478c97a-fa2f-4c75-9195-f6b5971e15fc-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Lock "cinder-e478c97a-fa2f-4c75-9195-f6b5971e15fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Acquiring lock "cinder-quobyte-e478c97a-fa2f-4c75-9195-f6b5971e15fc" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Lock "cinder-quobyte-e478c97a-fa2f-4c75-9195-f6b5971e15fc" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[be342aed-a223-4a9a-bcc7-8b07292849fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:18 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734" returned: 0 in 0.490s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:18 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc Sep 01 11:36:18 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:18 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734 Sep 01 11:36:18 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:18 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 1073741824" returned: 0 in 0.506s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:18 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 Sep 01 11:36:18 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:18 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e83e0b2c-ec38-4d23-8437-32667afc0734" returned: 0 in 0.357s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:18 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc" returned: 0 in 0.496s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-e83e0b2c-ec38-4d23-8437-32667afc0734" released by "delete_volume" :: held 0.969s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:18 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc Sep 01 11:36:18 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created reservations ['75d355cf-3f4f-4e23-a65f-721294cbadeb', 'eda1ef37-cbfd-49c6-b9cc-f964ca7050db', '95b62d99-e5f6-422c-b327-134389ab35dc', '5fe80afc-0dde-4818-a7fc-ebc9609283f5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:18 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71" returned: 0 in 0.339s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9513af-0000-4753-ac0e-5357f230632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5341eb40-9684-4505-b569-fead0aa15d71', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf433c5-9f61-4d86-8c62-6a81fbfa0f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Volume volume-5341eb40-9684-4505-b569-fead0aa15d71 (5341eb40-9684-4505-b569-fead0aa15d71): created successfully Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf433c5-9f61-4d86-8c62-6a81fbfa0f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (8b68da16-06ba-4618-ae79-38b5d77b90a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-cdd1874a-a7b7-4230-8edc-f64ab8ce16ad tempest-ProjectReaderTests-668839877 None] Created volume successfully. Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:18 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:18 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:18 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-e478c97a-fa2f-4c75-9195-f6b5971e15fc" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Lock "cinder-quobyte-e478c97a-fa2f-4c75-9195-f6b5971e15fc" released by "delete_volume" :: held 0.849s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:18 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Created reservations ['0efac4f9-06c8-4977-a761-38dda5aaf36d', 'c5e505a8-1e8c-46fa-b727-407894b47d7b', '72309883-c48b-4607-a0ba-f78932c67d8e', 'fb5355c5-08a7-4ee3-88fa-953cfacf9565'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:19 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:19 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:19 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.283s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Deleted volume successfully. Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6840717e-cdf5-44d5-826f-69cd0038e49b tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-e83e0b2c-ec38-4d23-8437-32667afc0734-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:19 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Deleted volume successfully. Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-20bfb880-d259-49e7-85ef-74de981b4efd tempest-VolumesNegativeTest-1518281781 None] Lock "cinder-e478c97a-fa2f-4c75-9195-f6b5971e15fc-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-5341eb40-9684-4505-b569-fead0aa15d71-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Lock "cinder-5341eb40-9684-4505-b569-fead0aa15d71-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-64982822-9e65-482d-b8d6-5353e89e2f0d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-quobyte-5341eb40-9684-4505-b569-fead0aa15d71" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-64982822-9e65-482d-b8d6-5353e89e2f0d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-5341eb40-9684-4505-b569-fead0aa15d71" acquired by "delete_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[02578b8d-d207-4966-ba63-dfe068c9328e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-quobyte-64982822-9e65-482d-b8d6-5353e89e2f0d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-64982822-9e65-482d-b8d6-5353e89e2f0d" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed306437-8f20-45bf-9d83-9b32e00e6ec5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:20 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 Sep 01 11:36:20 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:20 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d Sep 01 11:36:20 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:20 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71" returned: 0 in 0.462s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:20 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71 Sep 01 11:36:20 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:20 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d" returned: 0 in 0.555s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:20 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d Sep 01 11:36:20 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:20 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5341eb40-9684-4505-b569-fead0aa15d71" returned: 0 in 0.380s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-5341eb40-9684-4505-b569-fead0aa15d71" released by "delete_volume" :: held 0.923s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Created reservations ['08bbcbe4-67cf-4ee7-8776-0c0855b6c71d', '07d86948-368b-42ef-b079-860b600b61f0', '9a6dccbd-c055-42a9-8ab4-35cd9f9fa29a', 'c9ebaab4-768b-4b44-a5d6-27fa770ff128'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:20 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64982822-9e65-482d-b8d6-5353e89e2f0d" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-64982822-9e65-482d-b8d6-5353e89e2f0d" released by "delete_volume" :: held 0.983s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created reservations ['7cf12400-f8f7-4130-9c49-2fc5516005dd', 'a90b0049-fa91-4995-bc04-9fdb3323b6cb', 'ca6d0aeb-63b3-4cbb-b000-570ad6ba568d', '35ac9c66-9c46-4459-a6a3-c1fc2586c602'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:21 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:21 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:21 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:21 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:21 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Deleted volume successfully. Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d977d141-2ddb-4f74-a135-c16ea2155de3 tempest-ProjectReaderTests-668839877 None] Lock "cinder-5341eb40-9684-4505-b569-fead0aa15d71-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:21 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.332s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Deleted volume successfully. Sep 01 11:36:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3a93f667-c7b1-4325-ae9e-ce2b63b231da tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-64982822-9e65-482d-b8d6-5353e89e2f0d-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-1002ca6c-cefc-4b2a-98bf-0d60fba25894-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-1002ca6c-cefc-4b2a-98bf-0d60fba25894-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-quobyte-1002ca6c-cefc-4b2a-98bf-0d60fba25894" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-1002ca6c-cefc-4b2a-98bf-0d60fba25894" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d449ede3-5f03-4710-be3c-3858990e37ed]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:22 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 Sep 01 11:36:22 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Flow 'volume_create_manager' (b9948c8b-de02-40b8-8de5-0f21e07b1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf6fc38-f183-47af-805b-fbf903890b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf6fc38-f183-47af-805b-fbf903890b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-357878941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82a20a3-be70-4da4-870d-3e3f672449e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542efbc233c048448c0801fedf79ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:23Z,use_quota=True,user_id='d4e007e0558b41398e72050ee5d9484d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35ee6ca-6038-487f-8770-9aebbd0a81d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35ee6ca-6038-487f-8770-9aebbd0a81d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fb1868-692e-48e3-b37a-dbef02b6dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fb1868-692e-48e3-b37a-dbef02b6dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82a20a3-be70-4da4-870d-3e3f672449e2', 'volume_name': 'volume-c82a20a3-be70-4da4-870d-3e3f672449e2', 'volume_size': 2}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad8c445-b521-41ee-8754-29855bed0440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad8c445-b521-41ee-8754-29855bed0440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45203b8e-8a72-45fb-823b-5b96919d32c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Volume c82a20a3-be70-4da4-870d-3e3f672449e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82a20a3-be70-4da4-870d-3e3f672449e2', 'volume_size': 2} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-357878941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82a20a3-be70-4da4-870d-3e3f672449e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='542efbc233c048448c0801fedf79ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:23Z,use_quota=True,user_id='d4e007e0558b41398e72050ee5d9484d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Creating volume c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:22 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 2147483648 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:22 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 2147483648 Sep 01 11:36:22 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (2bee1b7b-3d39-440f-99d2-2ed9f66d92e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab23671-3c14-4e0f-98df-582667a42abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab23671-3c14-4e0f-98df-582667a42abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691804650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8757d2e2-f4c1-4e10-9ace-8a797875eb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:23Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13173d25-ced0-49f2-aafb-d445ede6e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13173d25-ced0-49f2-aafb-d445ede6e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c825d-f3f0-4ac9-90c8-6a53728f4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c825d-f3f0-4ac9-90c8-6a53728f4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8757d2e2-f4c1-4e10-9ace-8a797875eb8e', 'volume_name': 'volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71523a2-3394-4ccf-8184-3e4df82be3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71523a2-3394-4ccf-8184-3e4df82be3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c0d3d-cdc2-4467-bd28-62a10314876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Volume 8757d2e2-f4c1-4e10-9ace-8a797875eb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e', 'volume_size': 1} Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:22 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894" returned: 0 in 0.437s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:23 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894 Sep 01 11:36:23 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:23 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1002ca6c-cefc-4b2a-98bf-0d60fba25894" returned: 0 in 0.308s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-1002ca6c-cefc-4b2a-98bf-0d60fba25894" released by "delete_volume" :: held 0.800s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created reservations ['6fb325e1-5f4b-4ab6-a01f-327e1526908e', '22f9b012-4514-471d-84d0-8b634be0bbc4', '8485e970-1a91-40d6-9712-a54df517efba', '574a45bd-00b6-4f6e-a4aa-9e04d762a3c3'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:23 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 2147483648" returned: 0 in 0.635s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:23 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:23 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:23 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 Sep 01 11:36:23 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-97954117-8c1d-4576-aeb1-13ae4d622c4f-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-97954117-8c1d-4576-aeb1-13ae4d622c4f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "cinder-quobyte-97954117-8c1d-4576-aeb1-13ae4d622c4f" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-97954117-8c1d-4576-aeb1-13ae4d622c4f" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27dfc51-7ae1-4058-a4b7-6d886d5d55e4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:23 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.339s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Deleted volume successfully. Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6e78f2a5-aa42-4862-9db5-c4e088a62626 tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-1002ca6c-cefc-4b2a-98bf-0d60fba25894-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:23 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2" returned: 0 in 0.349s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691804650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8757d2e2-f4c1-4e10-9ace-8a797875eb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eab126c47db4290b0a21751f543c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:23Z,use_quota=True,user_id='5ecfc85b68184a5bbc5ce02c12453379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Creating volume 8757d2e2-f4c1-4e10-9ace-8a797875eb8e {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:23 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:23 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f Sep 01 11:36:23 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45203b8e-8a72-45fb-823b-5b96919d32c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82a20a3-be70-4da4-870d-3e3f672449e2', 'volume_size': 2}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efaee1b-395a-4b05-a765-a7f8cf23d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:23 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e 1073741824 Sep 01 11:36:23 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Volume volume-c82a20a3-be70-4da4-870d-3e3f672449e2 (c82a20a3-be70-4da4-870d-3e3f672449e2): created successfully Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efaee1b-395a-4b05-a765-a7f8cf23d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Flow 'volume_create_manager' (b9948c8b-de02-40b8-8de5-0f21e07b1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b98e6225-a1a9-4af3-a05e-e0dd1a04b532 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Created volume successfully. Sep 01 11:36:24 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f" returned: 0 in 0.451s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:24 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f Sep 01 11:36:24 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:24 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e 1073741824" returned: 0 in 0.702s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:24 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-97954117-8c1d-4576-aeb1-13ae4d622c4f" returned: 0 in 0.469s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:24 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e Sep 01 11:36:24 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-quobyte-97954117-8c1d-4576-aeb1-13ae4d622c4f" released by "delete_volume" :: held 0.988s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Created reservations ['5164226a-827f-4773-8ae0-64a0dddb7aa5', '50bf2acb-6a3c-45c3-94b1-4cbf76dd811a', 'd339cafc-7ca2-4962-a533-813c4d977225', '3c412e2a-b393-4d8f-9ed4-e806b341aa99'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:24 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:24 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:25 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e" returned: 0 in 0.377s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c0d3d-cdc2-4467-bd28-62a10314876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b498aeb-e2cd-4084-8cfb-c40151796a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Creating offline snapshot 87efa232-c0b7-4b68-8bfb-8c37e3e29eca of volume c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:36:25 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Volume volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e (8757d2e2-f4c1-4e10-9ace-8a797875eb8e): created successfully Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b498aeb-e2cd-4084-8cfb-c40151796a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Flow 'volume_create_manager' (2bee1b7b-3d39-440f-99d2-2ed9f66d92e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ef6fa-ff0d-4cb3-afea-89e0aa9599ab]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2dd9a11a-491b-4599-ab0a-36438d6c5fc2 tempest-ProjectReaderTests-668839877 None] Created volume successfully. Sep 01 11:36:25 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.280s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Deleted volume successfully. Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-08a3a1b9-bfc0-4e90-b1a3-46645746fb1c tempest-CreateVolumesFromSourceVolumeTest-142859487 None] Lock "cinder-97954117-8c1d-4576-aeb1-13ae4d622c4f-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:25 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 Sep 01 11:36:25 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:25 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2" returned: 0 in 0.431s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca 2G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:25 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca 2G Sep 01 11:36:25 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-8757d2e2-f4c1-4e10-9ace-8a797875eb8e-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Lock "cinder-8757d2e2-f4c1-4e10-9ace-8a797875eb8e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Acquiring lock "cinder-quobyte-8757d2e2-f4c1-4e10-9ace-8a797875eb8e" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-8757d2e2-f4c1-4e10-9ace-8a797875eb8e" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e651aee-3ce1-4bf9-8441-1d8fc9d109d3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:26 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca 2G" returned: 0 in 0.569s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c82a20a3-be70-4da4-870d-3e3f672449e2 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:26 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e Sep 01 11:36:26 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:26 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c82a20a3-be70-4da4-870d-3e3f672449e2 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca Sep 01 11:36:26 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:26 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e" returned: 0 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:26 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e Sep 01 11:36:26 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:26 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c82a20a3-be70-4da4-870d-3e3f672449e2 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:26 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca is being set with open permissions: ugo+rw Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:26 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca Sep 01 11:36:26 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:26 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8757d2e2-f4c1-4e10-9ace-8a797875eb8e" returned: 0 in 0.337s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Lock "cinder-quobyte-8757d2e2-f4c1-4e10-9ace-8a797875eb8e" released by "delete_volume" :: held 0.811s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:26 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca" returned: 0 in 0.335s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Created reservations ['34b1cd6e-a330-4112-a875-114907cb50c4', 'dafe8982-617f-45f5-bea4-9f31648416d5', '3bd93185-a469-4a90-a7ba-7737e346109d', '21a0a284-d270-4fc0-b79e-b65fe4c4490f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:26 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info Sep 01 11:36:26 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:27 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:27 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:27 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:27 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info is being set with open permissions: ugo+rw Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:27 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info Sep 01 11:36:27 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:27 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.480s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Deleted volume successfully. Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-40fc3777-b088-4ad3-a430-8fdaf6370198 tempest-ProjectReaderTests-668839877 None] Lock "cinder-8757d2e2-f4c1-4e10-9ace-8a797875eb8e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:27 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.info" returned: 0 in 0.531s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4f42a420-264f-493a-a901-a92bff14481d tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Create snapshot completed successfully Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "cinder-87efa232-c0b7-4b68-8bfb-8c37e3e29eca-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-87efa232-c0b7-4b68-8bfb-8c37e3e29eca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "cinder-quobyte-c82a20a3-be70-4da4-870d-3e3f672449e2" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-quobyte-c82a20a3-be70-4da4-870d-3e3f672449e2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "cinder-quobyte-87efa232-c0b7-4b68-8bfb-8c37e3e29eca" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-quobyte-87efa232-c0b7-4b68-8bfb-8c37e3e29eca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Deleting offline snapshot 87efa232-c0b7-4b68-8bfb-8c37e3e29eca of volume c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] snapshot_file for this snap is: volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09151657-6e74-443d-bbc0-59a059896844]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:28 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca Sep 01 11:36:28 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:29 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca" returned: 0 in 0.626s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c82a20a3-be70-4da4-870d-3e3f672449e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:36:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca6cf9-c403-4e61-a8ca-f29b5a6c4cdf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:29 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 Sep 01 11:36:29 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:29 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2" returned: 0 in 0.497s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:29 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca Sep 01 11:36:29 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:30 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca" returned: 0 in 0.474s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:30 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca Sep 01 11:36:30 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:30 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2.87efa232-c0b7-4b68-8bfb-8c37e3e29eca" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-quobyte-87efa232-c0b7-4b68-8bfb-8c37e3e29eca" released by "_delete_snapshot" :: held 2.014s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-quobyte-c82a20a3-be70-4da4-870d-3e3f672449e2" released by "delete_snapshot" :: held 2.050s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Created reservations ['1baa55bb-f732-4276-9acf-2b13c08b4aa8', '1cb56290-5a18-4d55-b126-f9925d737e22', '0123e0cf-86a0-42b8-8614-8c7085d0de3a', 'ad57fad5-d46c-4a67-8352-9b8fde58278c'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Delete snapshot completed successfully. Sep 01 11:36:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ed9ab7c8-40be-4dc5-8b3e-28f73f85acc4 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-87efa232-c0b7-4b68-8bfb-8c37e3e29eca-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "cinder-c82a20a3-be70-4da4-870d-3e3f672449e2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-c82a20a3-be70-4da4-870d-3e3f672449e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "cinder-quobyte-c82a20a3-be70-4da4-870d-3e3f672449e2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-quobyte-c82a20a3-be70-4da4-870d-3e3f672449e2" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cbf9cd-731a-471c-8565-c8e9c1005952]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:32 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 Sep 01 11:36:32 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:32 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2" returned: 0 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:32 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2 Sep 01 11:36:32 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:32 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c82a20a3-be70-4da4-870d-3e3f672449e2" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-quobyte-c82a20a3-be70-4da4-870d-3e3f672449e2" released by "delete_volume" :: held 0.791s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Created reservations ['5ad175c7-203c-4ea5-b837-95a1261cd284', 'e4f45149-6a79-44f5-889d-71b8f07bd278', 'd5c3ae3e-dece-4950-9f14-eadad3842c69', 'bde41c8a-1e65-4c2a-8fff-2ef3f188c5e0'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:32 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:32 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:33 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.313s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:33 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Deleted volume successfully. Sep 01 11:36:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-41235b1b-43ef-4c83-8ef5-54c1e211d850 tempest-VolumesSnapshotNegativeTestJSON-1659548981 None] Lock "cinder-c82a20a3-be70-4da4-870d-3e3f672449e2-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:36 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=179,cinder:INSERT=67,cinder:UPDATE=280,cinder:DELETE=28 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:36:36 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=264,cinder:DELETE=19,cinder:SELECT=190,cinder:INSERT=60 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:36:36 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (316f9229-3e77-4c8b-8dc8-d28b43b28d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267a0356-96a5-4727-b8b2-aafba4d41047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267a0356-96a5-4727-b8b2-aafba4d41047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724251104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cabbc0-0485-4ac4-abad-faf99c2c69f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:37Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbaff68-b3fb-4dac-8898-9c204fb70c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbaff68-b3fb-4dac-8898-9c204fb70c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05997ee-50b0-48f3-8d08-ae6f1fa15f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05997ee-50b0-48f3-8d08-ae6f1fa15f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cabbc0-0485-4ac4-abad-faf99c2c69f6', 'volume_name': 'volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df3dbeb-c2f9-4d58-9218-158d27b1b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df3dbeb-c2f9-4d58-9218-158d27b1b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe5b69a-78ad-42b5-9623-a199895a40de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Volume c0cabbc0-0485-4ac4-abad-faf99c2c69f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6', 'volume_size': 1} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724251104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cabbc0-0485-4ac4-abad-faf99c2c69f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:37Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Creating volume c0cabbc0-0485-4ac4-abad-faf99c2c69f6 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:37 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 1073741824 Sep 01 11:36:37 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (031ed3b5-a471-4023-ab41-a347e03793ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e580715-440f-4b3a-b7d2-0e30952a5ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e580715-440f-4b3a-b7d2-0e30952a5ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702911873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4ba29d-e04f-4598-8c49-9b3ca86118d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:37Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2ca868-1fc0-497e-b3e3-efbfa6f115d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2ca868-1fc0-497e-b3e3-efbfa6f115d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd1c1d8-746f-45f7-b0b0-88f89e12a0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd1c1d8-746f-45f7-b0b0-88f89e12a0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4ba29d-e04f-4598-8c49-9b3ca86118d4', 'volume_name': 'volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9785548-7579-4680-a63d-987d3d8c5926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9785548-7579-4680-a63d-987d3d8c5926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c1ed77-a975-4c1a-9131-0405db8ef327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Volume 6a4ba29d-e04f-4598-8c49-9b3ca86118d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4', 'volume_size': 1} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:37 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 1073741824" returned: 0 in 0.531s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:37 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 Sep 01 11:36:37 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (5604375d-8c18-4dee-8dd6-23c0f90c0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0314a742-f924-4f65-8d49-046e98acf88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0314a742-f924-4f65-8d49-046e98acf88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076425292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4151738b-6873-4624-a12b-7aea01747f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:38Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f93754a-bb2a-4ef6-a4eb-cad6fa33bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f93754a-bb2a-4ef6-a4eb-cad6fa33bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71537b8-47c0-442d-b021-dbc891e73362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71537b8-47c0-442d-b021-dbc891e73362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4151738b-6873-4624-a12b-7aea01747f63', 'volume_name': 'volume-4151738b-6873-4624-a12b-7aea01747f63', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e35a918-057e-4667-a5b4-ed5d8aea71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e35a918-057e-4667-a5b4-ed5d8aea71bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b01c677-d45e-4869-b0cc-a19e56a4d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Volume 4151738b-6873-4624-a12b-7aea01747f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4151738b-6873-4624-a12b-7aea01747f63', 'volume_size': 1} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:37 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702911873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4ba29d-e04f-4598-8c49-9b3ca86118d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:37Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Creating volume 6a4ba29d-e04f-4598-8c49-9b3ca86118d4 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe5b69a-78ad-42b5-9623-a199895a40de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cead0990-1d02-4278-86ef-8a247793fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 1073741824 Sep 01 11:36:38 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Volume volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 (c0cabbc0-0485-4ac4-abad-faf99c2c69f6): created successfully Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cead0990-1d02-4278-86ef-8a247793fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (316f9229-3e77-4c8b-8dc8-d28b43b28d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f10c9848-acb6-43a0-b87d-0af26ad6d6a8 tempest-CreateVolumesFromImageTest-837333343 None] Created volume successfully. Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (c934c8eb-3c93-474d-b3e3-0df613b92e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf6e6aa-4937-44e1-835e-8bf2e982e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf6e6aa-4937-44e1-835e-8bf2e982e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-611765739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85ccb6b-d077-411d-a991-b512e05ddc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:38Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d27011b-6f65-4ba8-b3de-a52e51455e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d27011b-6f65-4ba8-b3de-a52e51455e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16321a3-ceb4-4ee5-b69d-c98622ca341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16321a3-ceb4-4ee5-b69d-c98622ca341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85ccb6b-d077-411d-a991-b512e05ddc59', 'volume_name': 'volume-c85ccb6b-d077-411d-a991-b512e05ddc59', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5624f44-2172-4867-99ed-24292a71af78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5624f44-2172-4867-99ed-24292a71af78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd064fc5-e760-4ddf-a14f-eb03626e97ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Volume c85ccb6b-d077-411d-a991-b512e05ddc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85ccb6b-d077-411d-a991-b512e05ddc59', 'volume_size': 1} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:38 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 1073741824" returned: 0 in 0.654s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:38 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 Sep 01 11:36:38 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (4a44815b-2de4-4dcb-a18a-ef4918d59377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bed6ff-fef9-46ee-840c-da1fb1b03e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bed6ff-fef9-46ee-840c-da1fb1b03e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440494245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812cd926-78ff-4c0e-8175-1ca0006f169c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:39Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45173b36-9677-4ecf-a1e9-41506ded6a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45173b36-9677-4ecf-a1e9-41506ded6a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0cd6d7-442c-458b-babe-8ae0cbe4e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0cd6d7-442c-458b-babe-8ae0cbe4e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812cd926-78ff-4c0e-8175-1ca0006f169c', 'volume_name': 'volume-812cd926-78ff-4c0e-8175-1ca0006f169c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed60a0e0-1603-4e17-a248-132a18854333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed60a0e0-1603-4e17-a248-132a18854333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31b3887-6b56-4989-aeb5-b42ac2cc9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Volume 812cd926-78ff-4c0e-8175-1ca0006f169c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812cd926-78ff-4c0e-8175-1ca0006f169c', 'volume_size': 1} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:38 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076425292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4151738b-6873-4624-a12b-7aea01747f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:38Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Creating volume 4151738b-6873-4624-a12b-7aea01747f63 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:38 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c1ed77-a975-4c1a-9131-0405db8ef327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:39 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 1073741824 Sep 01 11:36:39 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9899f78-cd95-40b5-8ca5-4cc8727f85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:39 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Volume volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 (6a4ba29d-e04f-4598-8c49-9b3ca86118d4): created successfully Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9899f78-cd95-40b5-8ca5-4cc8727f85db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (031ed3b5-a471-4023-ab41-a347e03793ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ec8a72e6-9187-4de9-8373-5056c196aaab tempest-CreateVolumesFromImageTest-837333343 None] Created volume successfully. Sep 01 11:36:39 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 1073741824" returned: 0 in 0.454s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:39 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 Sep 01 11:36:39 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:39 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63" returned: 0 in 0.247s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-611765739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85ccb6b-d077-411d-a991-b512e05ddc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:38Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Creating volume c85ccb6b-d077-411d-a991-b512e05ddc59 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:39 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:39 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 1073741824 Sep 01 11:36:39 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b01c677-d45e-4869-b0cc-a19e56a4d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4151738b-6873-4624-a12b-7aea01747f63', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35302c9-9297-4aba-9a5a-877363f9c56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:39 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Volume volume-4151738b-6873-4624-a12b-7aea01747f63 (4151738b-6873-4624-a12b-7aea01747f63): created successfully Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35302c9-9297-4aba-9a5a-877363f9c56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:39 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (5604375d-8c18-4dee-8dd6-23c0f90c0706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-937994bc-d592-4db5-962f-2b3399c59c70 tempest-CreateVolumesFromImageTest-837333343 None] Created volume successfully. Sep 01 11:36:40 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 1073741824" returned: 0 in 0.555s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:40 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 Sep 01 11:36:40 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:40 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59" returned: 0 in 0.289s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440494245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812cd926-78ff-4c0e-8175-1ca0006f169c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f370de3647346ac9d803fcf796b30e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:39Z,use_quota=True,user_id='8692c9d3f8344b6eb840576f3058a62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Creating volume 812cd926-78ff-4c0e-8175-1ca0006f169c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:40 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:40 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c 1073741824 Sep 01 11:36:40 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd064fc5-e760-4ddf-a14f-eb03626e97ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85ccb6b-d077-411d-a991-b512e05ddc59', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8903e345-0261-4643-adea-5447e35b5230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Volume volume-c85ccb6b-d077-411d-a991-b512e05ddc59 (c85ccb6b-d077-411d-a991-b512e05ddc59): created successfully Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8903e345-0261-4643-adea-5447e35b5230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (c934c8eb-3c93-474d-b3e3-0df613b92e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-018974cd-2df2-40c6-a454-81d70ef1c468 tempest-CreateVolumesFromImageTest-837333343 None] Created volume successfully. Sep 01 11:36:41 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c 1073741824" returned: 0 in 0.540s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:41 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c Sep 01 11:36:41 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:41 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31b3887-6b56-4989-aeb5-b42ac2cc9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812cd926-78ff-4c0e-8175-1ca0006f169c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42b3b37-1b52-41bc-86e3-b46df1f92d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:41 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Volume volume-812cd926-78ff-4c0e-8175-1ca0006f169c (812cd926-78ff-4c0e-8175-1ca0006f169c): created successfully Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42b3b37-1b52-41bc-86e3-b46df1f92d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Flow 'volume_create_manager' (4a44815b-2de4-4dcb-a18a-ef4918d59377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-be3cb462-37d1-40f5-86e9-1730d36e13a1 tempest-CreateVolumesFromImageTest-837333343 None] Created volume successfully. Sep 01 11:36:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-812cd926-78ff-4c0e-8175-1ca0006f169c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-812cd926-78ff-4c0e-8175-1ca0006f169c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-quobyte-812cd926-78ff-4c0e-8175-1ca0006f169c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-812cd926-78ff-4c0e-8175-1ca0006f169c" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dbe302-76ea-43c5-b8f5-3044e12af4b4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:42 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c Sep 01 11:36:42 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:43 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c" returned: 0 in 0.454s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:43 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c Sep 01 11:36:43 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:43 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-812cd926-78ff-4c0e-8175-1ca0006f169c" returned: 0 in 0.277s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-812cd926-78ff-4c0e-8175-1ca0006f169c" released by "delete_volume" :: held 0.775s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Created reservations ['425ed946-e5e8-4981-a94b-6a9e64fcf9c3', '21cdc700-5bdf-4de7-b2b8-b7ab5a8f4750', 'c293df8e-c6b3-4015-a1cf-6fa1f86795e9', '98be7d99-c02c-4a29-9ef3-e7fd2e01c1e2'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:43 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:43 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-c85ccb6b-d077-411d-a991-b512e05ddc59-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-c85ccb6b-d077-411d-a991-b512e05ddc59-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:43 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-quobyte-c85ccb6b-d077-411d-a991-b512e05ddc59" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Deleted volume successfully. Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-c85ccb6b-d077-411d-a991-b512e05ddc59" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8b736289-8b06-4c64-a412-569593c9d380 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-812cd926-78ff-4c0e-8175-1ca0006f169c-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb064cac-911c-4a20-881c-a0022fab4aa7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:44 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 Sep 01 11:36:44 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Flow 'volume_create_manager' (8c3e70cf-b478-4db1-a1d4-82b8056b8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc2841c-6946-441b-8141-e295a0322fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc2841c-6946-441b-8141-e295a0322fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1472460538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c045e7e-a2ca-4337-9f20-07290ceb5635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785a936bb79c4a209d8db33044e2005a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:44Z,use_quota=True,user_id='be0bbfa799b84fb695ce9ffd38d8962d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7b929e-db4f-4328-a1c8-d750556482f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7b929e-db4f-4328-a1c8-d750556482f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e42ed6d-5655-4754-9a49-4af2313662b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e42ed6d-5655-4754-9a49-4af2313662b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c045e7e-a2ca-4337-9f20-07290ceb5635', 'volume_name': 'volume-6c045e7e-a2ca-4337-9f20-07290ceb5635', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a264c10-8db6-4190-bdab-51186e18a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a264c10-8db6-4190-bdab-51186e18a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7132fa-c796-4cb4-afda-ef0d8db35b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Volume 6c045e7e-a2ca-4337-9f20-07290ceb5635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c045e7e-a2ca-4337-9f20-07290ceb5635', 'volume_size': 1} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1472460538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c045e7e-a2ca-4337-9f20-07290ceb5635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785a936bb79c4a209d8db33044e2005a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:44Z,use_quota=True,user_id='be0bbfa799b84fb695ce9ffd38d8962d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Creating volume 6c045e7e-a2ca-4337-9f20-07290ceb5635 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:44 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59" returned: 0 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:44 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 1073741824 Sep 01 11:36:44 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:44 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59 Sep 01 11:36:44 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:44 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c85ccb6b-d077-411d-a991-b512e05ddc59" returned: 0 in 0.389s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Flow 'volume_create_manager' (822f3325-825d-4d71-a7ec-eedf41ca80e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306d75b2-815f-4717-9c8b-b9dd06eda268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-c85ccb6b-d077-411d-a991-b512e05ddc59" released by "delete_volume" :: held 0.998s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306d75b2-815f-4717-9c8b-b9dd06eda268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1603523333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb985c3-dbdc-45b0-99ef-38823ab5f714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785a936bb79c4a209d8db33044e2005a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:45Z,use_quota=True,user_id='be0bbfa799b84fb695ce9ffd38d8962d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd7c3ca-fc9d-460f-9856-866008e1b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd7c3ca-fc9d-460f-9856-866008e1b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc0b47-d3c2-4265-b85a-93b0d4252ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc0b47-d3c2-4265-b85a-93b0d4252ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb985c3-dbdc-45b0-99ef-38823ab5f714', 'volume_name': 'volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55712d8-a91b-44d1-ba03-bc59f0928ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55712d8-a91b-44d1-ba03-bc59f0928ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0021e0-4727-4d8d-ac81-f7712ad31697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Volume ffb985c3-dbdc-45b0-99ef-38823ab5f714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714', 'volume_size': 1} Sep 01 11:36:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Created reservations ['011e3dcc-e842-4f8a-ae8e-bdb5de8b375a', 'ae45db4b-515c-4941-86bf-c1ff74497761', '1b3c2230-9891-4037-bd1d-6c2338e60ea9', '6bb138ea-dea7-4d1b-8e0b-73aa84a56c35'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:45 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:45 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:45 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 1073741824" returned: 0 in 0.721s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:45 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 Sep 01 11:36:45 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:45 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.269s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Deleted volume successfully. Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-66ec3992-fc28-40d4-9442-d5aa18b9ea7a tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-c85ccb6b-d077-411d-a991-b512e05ddc59-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:45 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635" returned: 0 in 0.270s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1603523333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb985c3-dbdc-45b0-99ef-38823ab5f714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785a936bb79c4a209d8db33044e2005a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:36:45Z,use_quota=True,user_id='be0bbfa799b84fb695ce9ffd38d8962d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Creating volume ffb985c3-dbdc-45b0-99ef-38823ab5f714 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:36:45 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7132fa-c796-4cb4-afda-ef0d8db35b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c045e7e-a2ca-4337-9f20-07290ceb5635', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:45 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 1073741824 Sep 01 11:36:45 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79859e5e-bf77-46df-a1f9-7d15268354f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Volume volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 (6c045e7e-a2ca-4337-9f20-07290ceb5635): created successfully Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79859e5e-bf77-46df-a1f9-7d15268354f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Flow 'volume_create_manager' (8c3e70cf-b478-4db1-a1d4-82b8056b8e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-37baa81d-1e8a-4a90-b762-cc56b575bb75 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Created volume successfully. Sep 01 11:36:45 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 1073741824" returned: 0 in 0.500s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-4151738b-6873-4624-a12b-7aea01747f63-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:46 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 Sep 01 11:36:46 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-4151738b-6873-4624-a12b-7aea01747f63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-quobyte-4151738b-6873-4624-a12b-7aea01747f63" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-4151738b-6873-4624-a12b-7aea01747f63" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83f770c-069a-4629-a3ce-b5cd683b9f62]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:46 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 Sep 01 11:36:46 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:46 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0021e0-4727-4d8d-ac81-f7712ad31697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816b7458-5990-4f90-94ad-aeb64163cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:36:46 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Volume volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 (ffb985c3-dbdc-45b0-99ef-38823ab5f714): created successfully Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816b7458-5990-4f90-94ad-aeb64163cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Flow 'volume_create_manager' (822f3325-825d-4d71-a7ec-eedf41ca80e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:36:46 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d1ab70c7-0cd8-41e7-9201-09250bd1204c tempest-TestServerVolumeAttachmentScenario-1995067110 None] Created volume successfully. Sep 01 11:36:46 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:46 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63 Sep 01 11:36:46 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:46 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4151738b-6873-4624-a12b-7aea01747f63" returned: 0 in 0.256s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-4151738b-6873-4624-a12b-7aea01747f63" released by "delete_volume" :: held 0.703s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Created reservations ['8988ed30-5ea8-4f11-a308-fadb3f1af8a0', 'c3c5150f-0175-4da5-9d8d-29fd23e945a7', '08209f2f-37e1-44a7-a321-a16782caeace', '52c40d30-b1d6-47c4-b83a-0545a5b0fcf8'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:47 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:47 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-6a4ba29d-e04f-4598-8c49-9b3ca86118d4-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:47 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.277s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Deleted volume successfully. Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-6a4ba29d-e04f-4598-8c49-9b3ca86118d4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0f668e25-1cf8-4c48-8925-b17eddeb7429 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-4151738b-6873-4624-a12b-7aea01747f63-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-quobyte-6a4ba29d-e04f-4598-8c49-9b3ca86118d4" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-6a4ba29d-e04f-4598-8c49-9b3ca86118d4" acquired by "delete_volume" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5df75c-5ade-42b3-8da0-192e38505f24]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:47 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 Sep 01 11:36:47 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:47 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:47 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4 Sep 01 11:36:47 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:48 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6a4ba29d-e04f-4598-8c49-9b3ca86118d4" returned: 0 in 0.272s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-6a4ba29d-e04f-4598-8c49-9b3ca86118d4" released by "delete_volume" :: held 0.694s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Created reservations ['d004f5bd-bbdb-43a9-b924-8cec7456255e', '648e9a61-8832-4833-bc89-07a517cd90f0', '8689403a-c3d1-455f-852f-390acddfbf10', '335f60ed-d889-47e4-beab-098c60cde419'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:48 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:48 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:48 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Deleted volume successfully. Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-c0cabbc0-0485-4ac4-abad-faf99c2c69f6-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d9f29e36-3857-4acc-b10a-10f5cc721805 tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-6a4ba29d-e04f-4598-8c49-9b3ca86118d4-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-c0cabbc0-0485-4ac4-abad-faf99c2c69f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "cinder-quobyte-c0cabbc0-0485-4ac4-abad-faf99c2c69f6" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-c0cabbc0-0485-4ac4-abad-faf99c2c69f6" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[37154d9d-db24-4e21-b00f-4dfef8f212df]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:48 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 Sep 01 11:36:48 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:48 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6" returned: 0 in 0.409s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:49 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6 Sep 01 11:36:49 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:49 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c0cabbc0-0485-4ac4-abad-faf99c2c69f6" returned: 0 in 0.294s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-quobyte-c0cabbc0-0485-4ac4-abad-faf99c2c69f6" released by "delete_volume" :: held 0.758s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Created reservations ['be920d98-dd2b-418d-8b8c-1f9099d8f290', '9b837dda-e584-4688-8a45-c1bef333ff8d', '06e48934-0cc0-44dc-9c07-04de69649654', '38b8765c-82f8-40f0-9fb9-037c217b4813'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:36:49 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:36:49 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:36:49 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.341s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:36:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Deleted volume successfully. Sep 01 11:36:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9eafa19c-5567-48b4-9e56-f490ee2a221e tempest-CreateVolumesFromImageTest-837333343 None] Lock "cinder-c0cabbc0-0485-4ac4-abad-faf99c2c69f6-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:36:59 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=38,cinder:UPDATE=61,cinder:DELETE=6,cinder:INSERT=8 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:36:59 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=39,cinder:INSERT=19,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:04 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:37:04 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:04 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:37:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff9f44-57d4-4641-a5c2-96b5fed3dbff]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:17 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 Sep 01 11:37:17 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:17 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.380s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:37:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-6c045e7e-a2ca-4337-9f20-07290ceb5635', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ea2ca81-3136-45f4-856d-2ef7c96624d4', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:37:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-3f5d2162-af97-46ac-999c-4d923f24e755 req-9b018ca1-ee7c-4d4a-bc15-54093cb9b293 tempest-TestServerVolumeAttachmentScenario-1995067110 None] attachment_update completed successfully. Sep 01 11:37:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:37:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:37:21 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db0485-312f-4f73-85c0-ed4247d56044]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:37:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:21 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 Sep 01 11:37:21 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:21 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714" returned: 0 in 0.346s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.363s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:37:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9abc6a1d-be6f-4138-b11b-9fd6dee09b8d', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:37:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-381f2c52-ff84-4b9d-9338-049f1ccdd123 req-a7ed4ed5-fd38-4607-af1d-cd07412db34b tempest-TestServerVolumeAttachmentScenario-1995067110 None] attachment_update completed successfully. Sep 01 11:37:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-aa2e24e7-9060-4728-88b0-8b51e5799c2b req-c1154e6c-9b54-494d-ab76-971dc4bce8e2 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Terminate volume connection completed successfully. Sep 01 11:37:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-aa2e24e7-9060-4728-88b0-8b51e5799c2b req-c1154e6c-9b54-494d-ab76-971dc4bce8e2 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Deleting attachment 9abc6a1d-be6f-4138-b11b-9fd6dee09b8d. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:37:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-6c44a964-df5b-48c3-8844-d5caf9c17dfd req-9fea5f5f-2b9f-4e6d-ac78-5b78e51299cb tempest-TestServerVolumeAttachmentScenario-1995067110 None] Terminate volume connection completed successfully. Sep 01 11:37:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-6c44a964-df5b-48c3-8844-d5caf9c17dfd req-9fea5f5f-2b9f-4e6d-ac78-5b78e51299cb tempest-TestServerVolumeAttachmentScenario-1995067110 None] Deleting attachment 0ea2ca81-3136-45f4-856d-2ef7c96624d4. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "cinder-ffb985c3-dbdc-45b0-99ef-38823ab5f714-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-ffb985c3-dbdc-45b0-99ef-38823ab5f714-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "cinder-quobyte-ffb985c3-dbdc-45b0-99ef-38823ab5f714" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-quobyte-ffb985c3-dbdc-45b0-99ef-38823ab5f714" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d183f4-7e83-42ec-a399-e88e1f4d45a9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:30 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 Sep 01 11:37:30 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:30 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714" returned: 0 in 0.348s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:30 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714 Sep 01 11:37:30 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:30 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ffb985c3-dbdc-45b0-99ef-38823ab5f714" returned: 0 in 0.233s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-quobyte-ffb985c3-dbdc-45b0-99ef-38823ab5f714" released by "delete_volume" :: held 0.616s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Created reservations ['e502919f-e678-4473-9983-c97b9c80ae6e', '43953baf-5f09-431d-a16a-485568b69bfd', 'd4579101-dede-45de-9588-8930a09a85ac', '4d046dbd-6f55-4caf-b846-2c835b115477'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:37:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:30 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:37:30 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:31 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.239s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:37:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Deleted volume successfully. Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c5284b0f-e358-47ff-9b90-3f93557fef6b tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-ffb985c3-dbdc-45b0-99ef-38823ab5f714-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "cinder-6c045e7e-a2ca-4337-9f20-07290ceb5635-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-6c045e7e-a2ca-4337-9f20-07290ceb5635-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "cinder-quobyte-6c045e7e-a2ca-4337-9f20-07290ceb5635" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-quobyte-6c045e7e-a2ca-4337-9f20-07290ceb5635" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[73641da3-7877-4478-bb4a-3e404d6be0fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:31 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 Sep 01 11:37:31 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:31 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635" returned: 0 in 0.378s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:31 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635 Sep 01 11:37:31 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:31 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6c045e7e-a2ca-4337-9f20-07290ceb5635" returned: 0 in 0.247s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-quobyte-6c045e7e-a2ca-4337-9f20-07290ceb5635" released by "delete_volume" :: held 0.663s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Created reservations ['8598225f-9a02-4817-8de9-3880e08be488', '43423a7c-2289-4c4f-a22c-044a2a4b099d', '3da71587-4f45-4fae-80f4-faca04aa527b', 'e2e66532-b63d-4f2c-bed3-e5ad08613e76'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:37:32 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:37:32 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:37:32 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.229s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:37:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Deleted volume successfully. Sep 01 11:37:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fccc8b63-f3fb-46ed-b7bc-f32f03a0a5f8 tempest-TestServerVolumeAttachmentScenario-1995067110 None] Lock "cinder-6c045e7e-a2ca-4337-9f20-07290ceb5635-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:37:42 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=21,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:37:42 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=25,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Flow 'volume_create_manager' (b18286ed-ec62-4b9c-a0d6-3a6455fe4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea6881e-a38d-4e3a-aa19-d9a5a6469a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea6881e-a38d-4e3a-aa19-d9a5a6469a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1897106854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d6c7dd-df36-454a-8075-c831653d30c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6824f89367e4765ba7629f21813dd17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:38:03Z,use_quota=True,user_id='729890a48438416b9de348a7acebc9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b350f34-81ae-42c9-9a61-2ff270979088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b350f34-81ae-42c9-9a61-2ff270979088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148ad863-13a6-42c3-8003-afc9e2ee0f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148ad863-13a6-42c3-8003-afc9e2ee0f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89d6c7dd-df36-454a-8075-c831653d30c9', 'volume_name': 'volume-89d6c7dd-df36-454a-8075-c831653d30c9', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f724a35-6cb7-4629-b486-a5b1b4405d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f724a35-6cb7-4629-b486-a5b1b4405d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e136a14b-7cad-4895-846d-8e06a27f154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:38:02 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Volume 89d6c7dd-df36-454a-8075-c831653d30c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89d6c7dd-df36-454a-8075-c831653d30c9', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 11:38:02 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Trying to clone 89d6c7dd-df36-454a-8075-c831653d30c9 from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:38:03 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Image download 20.69 MB at 20.69 MB/s Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf8e793-bafe-4d9b-b49f-039fbf6e0196]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:03 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD Sep 01 11:38:03 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:03 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b is fetched for user 729890a48438416b9de348a7acebc9f9. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8695bc-b0ec-44d5-a629-69d7efa39ddc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:03 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD Sep 01 11:38:03 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:04 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1897106854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d6c7dd-df36-454a-8075-c831653d30c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6824f89367e4765ba7629f21813dd17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:38:03Z,use_quota=True,user_id='729890a48438416b9de348a7acebc9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Creating volume 89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:38:04 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:04 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 1073741824 Sep 01 11:38:04 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:04 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 1073741824" returned: 0 in 0.388s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:04 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:04 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:04 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:38:04 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:04 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 0.241s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Attempting download of 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume 89d6c7dd-df36-454a-8075-c831653d30c9. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5deb38-889f-401a-b72a-adc23f54cf0b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:04 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.245s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:38:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:38:04 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza Sep 01 11:38:04 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:05 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza" returned: 0 in 0.316s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:05 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza Sep 01 11:38:05 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:05 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza" returned: 1 in 0.316s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_9mazwdza' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[95633c0f-eea4-4421-aeb3-45ffd01ba53e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:05 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD Sep 01 11:38:05 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:05 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b was qcow2, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:38:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:05 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:05 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:07 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 1.318s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b_y9ps1ly_devstack@QuobyteHD, size 112.00 MB, duration 1.32 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:38:07 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Converted 112.00 MB image at 84.87 MB/s Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:07 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 1G Sep 01 11:38:07 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:07 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 1G" returned: 0 in 0.269s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b99a45-adc2-470f-8988-f4dfadf70003]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:07 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:07 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:07 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 0.333s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:07 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:07 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:08 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 1 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Downloaded image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b ((None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}])) to volume 89d6c7dd-df36-454a-8075-c831653d30c9 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Temporary image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b for user 729890a48438416b9de348a7acebc9f9 is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Marking volume 89d6c7dd-df36-454a-8075-c831653d30c9 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Copying metadata from image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b to 89d6c7dd-df36-454a-8075-c831653d30c9. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Creating volume glance metadata for volume 89d6c7dd-df36-454a-8075-c831653d30c9 backed by image 71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e136a14b-7cad-4895-846d-8e06a27f154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d6c7dd-df36-454a-8075-c831653d30c9', 'volume_size': 1, 'image_id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48e2636708364007b8acdb005d09bd46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b', 'created_at': datetime.datetime(2026, 9, 1, 9, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d7ebb0-f1a2-4d03-95c3-2b8fe055bf3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c2051f-edf5-41ef-a290-edde708968f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:38:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Volume volume-89d6c7dd-df36-454a-8075-c831653d30c9 (89d6c7dd-df36-454a-8075-c831653d30c9): created successfully Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c2051f-edf5-41ef-a290-edde708968f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:38:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Flow 'volume_create_manager' (b18286ed-ec62-4b9c-a0d6-3a6455fe4172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:38:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f34f6cd6-ea01-4f99-85f0-0f147e1f7a95 tempest-TestShelveInstance-1940393720 None] Created volume successfully. Sep 01 11:38:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:38:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:38:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71e393-2175-45b8-8e91-27c9063aff43]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:11 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:11 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:11 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 0.392s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:11 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:11 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:12 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 1 in 0.373s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:38:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.804s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:38:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-89d6c7dd-df36-454a-8075-c831653d30c9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df8b9ff3-2afa-4024-b0fb-9927d3291928', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:38:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-4855a7ac-0658-4f4c-b4e5-8692184deeeb req-f7c54535-5821-4c95-847f-2b2004c19ffe tempest-TestShelveInstance-1940393720 None] attachment_update completed successfully. Sep 01 11:38:22 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=7,cinder:SELECT=13,cinder:INSERT=8 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:38:22 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:38:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-c83140d9-a514-439c-b296-ac41ebcd2501 req-5fded23c-3841-4c31-acd8-33a0892d2c19 tempest-TestShelveInstance-1940393720 None] Terminate volume connection completed successfully. Sep 01 11:38:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-c83140d9-a514-439c-b296-ac41ebcd2501 req-5fded23c-3841-4c31-acd8-33a0892d2c19 tempest-TestShelveInstance-1940393720 None] Deleting attachment df8b9ff3-2afa-4024-b0fb-9927d3291928. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd400f-ab77-4e0f-ae11-42932ea75458]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:43 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:43 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:43 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 0.374s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:38:43 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:38:43 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:38:43 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 1 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:38:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:38:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223', 'name': 'volume-89d6c7dd-df36-454a-8075-c831653d30c9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c72995b2-3aa8-43aa-9676-5a0ff6ea35fc', 'enforce_multipath': True} {{(pid=87144) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 11:38:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-11cea59a-9e74-420c-9600-91edb7a1cc82 req-bb9dd82e-7880-454d-a36e-e1a79b164c16 tempest-TestShelveInstance-1940393720 None] attachment_update completed successfully. Sep 01 11:38:54 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:38:54 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:04 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:39:04 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:04 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.237s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:39:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:39:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-c0c2a0d5-f91d-4b15-a345-a82e6bf3aae6 tempest-TestShelveInstance-1940393720 None] Terminate volume connection completed successfully. Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-c0c2a0d5-f91d-4b15-a345-a82e6bf3aae6 tempest-TestShelveInstance-1940393720 None] Deleting attachment c72995b2-3aa8-43aa-9676-5a0ff6ea35fc. {{(pid=87144) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Acquiring lock "cinder-89d6c7dd-df36-454a-8075-c831653d30c9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Lock "cinder-89d6c7dd-df36-454a-8075-c831653d30c9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Acquiring lock "cinder-quobyte-89d6c7dd-df36-454a-8075-c831653d30c9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Lock "cinder-quobyte-89d6c7dd-df36-454a-8075-c831653d30c9" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[63981a05-7c17-4110-98b8-433918bbc9af]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:11 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:39:11 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:11 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 0.371s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:11 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:39:11 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:11 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 1 in 0.359s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:39:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:11 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9 Sep 01 11:39:11 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:11 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-89d6c7dd-df36-454a-8075-c831653d30c9" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Lock "cinder-quobyte-89d6c7dd-df36-454a-8075-c831653d30c9" released by "delete_volume" :: held 1.095s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG cinder.quota [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Created reservations ['6bcd5127-7dfc-4b73-8cd2-c0efca82fdaf', '0e624f12-34ce-416c-b76a-3e878e2c17b9', '563e16d7-abbd-489e-9b8f-476004edf911', 'bceef34f-6440-4c68-bd88-dc94c4c427ea'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:12 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:39:12 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:12 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG cinder.manager [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:39:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Deleted volume successfully. Sep 01 11:39:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [req-c7e47a06-c314-46cd-b142-dcd8c677617d req-af276e7a-e67b-4779-ab93-e7695797f12b tempest-TestShelveInstance-1940393720 None] Lock "cinder-89d6c7dd-df36-454a-8075-c831653d30c9-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:22 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:39:22 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Flow 'volume_create_manager' (d9995160-4659-4549-89c8-db37b9426694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d949fe-97cb-4ad1-b130-edb3e2606f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d949fe-97cb-4ad1-b130-edb3e2606f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-360382953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cba574-6417-443a-81b0-6f7a07e59eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b709e95ba423423e9f1af294a42f6b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:39:42Z,use_quota=True,user_id='d0da9104307d495291941e3d8a6b6575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e363e4-876d-499b-ae54-79aea8abe2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e363e4-876d-499b-ae54-79aea8abe2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703503aa-06e3-405d-89d1-86250e290a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703503aa-06e3-405d-89d1-86250e290a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cba574-6417-443a-81b0-6f7a07e59eba', 'volume_name': 'volume-53cba574-6417-443a-81b0-6f7a07e59eba', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc77e073-82cc-456e-a2b0-db27b91762fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc77e073-82cc-456e-a2b0-db27b91762fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d36ecd-d69a-4444-88f7-7b0a592084b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:41 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Volume 53cba574-6417-443a-81b0-6f7a07e59eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cba574-6417-443a-81b0-6f7a07e59eba', 'volume_size': 1} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-360382953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cba574-6417-443a-81b0-6f7a07e59eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b709e95ba423423e9f1af294a42f6b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:39:42Z,use_quota=True,user_id='d0da9104307d495291941e3d8a6b6575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Creating volume 53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:39:41 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:39:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:41 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba 1073741824 Sep 01 11:39:41 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:42 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba 1073741824" returned: 0 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:42 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:42 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:42 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d36ecd-d69a-4444-88f7-7b0a592084b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cba574-6417-443a-81b0-6f7a07e59eba', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baabd587-2532-47b5-b4e7-3304080a2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Volume volume-53cba574-6417-443a-81b0-6f7a07e59eba (53cba574-6417-443a-81b0-6f7a07e59eba): created successfully Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baabd587-2532-47b5-b4e7-3304080a2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Flow 'volume_create_manager' (d9995160-4659-4549-89c8-db37b9426694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:39:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8225dfd6-2258-420c-9afb-282926e11fb3 tempest-SnapshotDependencyTests-399104255 None] Created volume successfully. Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Creating offline snapshot 7d322f84-ae31-407a-8da7-7e9b4d0c1d8a of volume 53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee87767-af03-4af6-996e-805784ae99c6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:43 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:43 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:43 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.355s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:43 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a 1G Sep 01 11:39:43 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:43 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a 1G" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cba574-6417-443a-81b0-6f7a07e59eba -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:43 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cba574-6417-443a-81b0-6f7a07e59eba -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a Sep 01 11:39:43 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:44 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cba574-6417-443a-81b0-6f7a07e59eba -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:44 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a is being set with open permissions: ugo+rw Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:44 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a Sep 01 11:39:44 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:44 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" returned: 0 in 0.238s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:44 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info Sep 01 11:39:44 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:44 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info" returned: 0 in 0.237s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:44 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info is being set with open permissions: ugo+rw Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:44 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info Sep 01 11:39:44 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:44 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.info" returned: 0 in 0.233s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-26a538e5-c644-4c5a-80f2-783bf0e830b7 tempest-SnapshotDependencyTests-399104255 None] Create snapshot completed successfully Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Flow 'volume_create_manager' (b8f9a784-5982-4cb0-84b3-a18c14cba1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6c300e-a6e7-4735-bd9b-4c6d296c3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6c300e-a6e7-4735-bd9b-4c6d296c3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833c00d5-c16f-4672-8172-aa9a9b8203ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b709e95ba423423e9f1af294a42f6b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d322f84-ae31-407a-8da7-7e9b4d0c1d8a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:39:46Z,use_quota=True,user_id='d0da9104307d495291941e3d8a6b6575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2a77e7-cba3-449e-95d6-73c3d64cb337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2a77e7-cba3-449e-95d6-73c3d64cb337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386e74d8-66fa-487c-99a5-131dd8dff57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386e74d8-66fa-487c-99a5-131dd8dff57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '833c00d5-c16f-4672-8172-aa9a9b8203ed', 'volume_name': 'volume-833c00d5-c16f-4672-8172-aa9a9b8203ed', 'volume_size': 1, 'snapshot_id': '7d322f84-ae31-407a-8da7-7e9b4d0c1d8a'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac58ed3-7eb6-4a6e-9582-df476637ec9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac58ed3-7eb6-4a6e-9582-df476637ec9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d382d806-0074-40f3-b770-1883dcd54915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Volume 833c00d5-c16f-4672-8172-aa9a9b8203ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-833c00d5-c16f-4672-8172-aa9a9b8203ed', 'volume_size': 1, 'snapshot_id': '7d322f84-ae31-407a-8da7-7e9b4d0c1d8a'} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-quobyte-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a-833c00d5-c16f-4672-8172-aa9a9b8203ed" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a-833c00d5-c16f-4672-8172-aa9a9b8203ed" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Creating volume 833c00d5-c16f-4672-8172-aa9a9b8203ed from snapshot 7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-quobyte-833c00d5-c16f-4672-8172-aa9a9b8203ed" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-833c00d5-c16f-4672-8172-aa9a9b8203ed" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] snapshot: 7d322f84-ae31-407a-8da7-7e9b4d0c1d8a, volume: 833c00d5-c16f-4672-8172-aa9a9b8203ed, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f142fce-7e00-4cdf-ba7b-0a369f402c42]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:46 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a Sep 01 11:39:46 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:46 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" returned: 0 in 0.351s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53cba574-6417-443a-81b0-6f7a07e59eba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc35cce-686c-4a71-949c-c302c2b7b5e7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:46 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:46 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:46 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.344s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:39:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:46 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed Sep 01 11:39:46 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:50 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed" returned: 0 in 3.831s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[061edfb3-4498-4d6f-9deb-aeafb1fe2e3b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:50 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:50 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:51 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.505s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba, size 1024.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:39:51 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Converted 1024.00 MB image at 267.22 MB/s Sep 01 11:39:51 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed is being set with open permissions: ugo+rw Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:51 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed Sep 01 11:39:51 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:51 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed" returned: 0 in 0.250s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-833c00d5-c16f-4672-8172-aa9a9b8203ed" released by "_copy_volume_from_snapshot" :: held 5.365s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a-833c00d5-c16f-4672-8172-aa9a9b8203ed" released by "_create_volume_from_snapshot" :: held 5.391s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.405s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d382d806-0074-40f3-b770-1883dcd54915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833c00d5-c16f-4672-8172-aa9a9b8203ed', 'volume_size': 1, 'snapshot_id': '7d322f84-ae31-407a-8da7-7e9b4d0c1d8a'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c73a612-97d4-405c-80ad-04356ab0b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:39:51 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Volume volume-833c00d5-c16f-4672-8172-aa9a9b8203ed (833c00d5-c16f-4672-8172-aa9a9b8203ed): created successfully Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c73a612-97d4-405c-80ad-04356ab0b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:39:51 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Flow 'volume_create_manager' (b8f9a784-5982-4cb0-84b3-a18c14cba1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:39:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0a671c43-eafa-45b7-aa7e-240cb99d4050 tempest-SnapshotDependencyTests-399104255 None] Created volume successfully. Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-quobyte-53cba574-6417-443a-81b0-6f7a07e59eba" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-53cba574-6417-443a-81b0-6f7a07e59eba" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-quobyte-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Deleting offline snapshot 7d322f84-ae31-407a-8da7-7e9b4d0c1d8a of volume 53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] snapshot_file for this snap is: volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302f436-7f04-4890-b797-34096fb27d47]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:52 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a Sep 01 11:39:52 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:52 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53cba574-6417-443a-81b0-6f7a07e59eba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa2b0d-87bd-4094-b4e6-0f34c9970558]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:52 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:52 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:53 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.340s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:53 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a Sep 01 11:39:53 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:53 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:53 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a Sep 01 11:39:53 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:53 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba.7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" returned: 0 in 0.228s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a" released by "_delete_snapshot" :: held 1.306s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-53cba574-6417-443a-81b0-6f7a07e59eba" released by "delete_snapshot" :: held 1.326s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Created reservations ['3df109bd-ed29-4368-8fee-65eb13591575', '9254db41-5f5d-4005-a16d-3dea9fe6dc0c', 'dd55f3b6-d65f-4c88-9e59-dfdd4ab562e0', 'c187bfde-6a25-4855-ae93-42aae929b030'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:39:53 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Delete snapshot completed successfully. Sep 01 11:39:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7a025233-3df5-42a7-8443-22f0bc1f72ef tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-7d322f84-ae31-407a-8da7-7e9b4d0c1d8a-delete_snapshot" released by "delete_snapshot" :: held 1.443s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-53cba574-6417-443a-81b0-6f7a07e59eba-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-53cba574-6417-443a-81b0-6f7a07e59eba-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-quobyte-53cba574-6417-443a-81b0-6f7a07e59eba" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-53cba574-6417-443a-81b0-6f7a07e59eba" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11c3ab-abad-4cf0-a64e-8c2e0b657b10]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:54 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:54 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:54 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.334s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:54 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba Sep 01 11:39:54 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:55 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-53cba574-6417-443a-81b0-6f7a07e59eba" returned: 0 in 0.231s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-53cba574-6417-443a-81b0-6f7a07e59eba" released by "delete_volume" :: held 0.615s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Created reservations ['76c7a272-061b-4bbc-8928-7b179919a191', '23965084-ea55-413f-b6e2-5bce6571de1a', '1d8a68fb-f70b-444c-95a4-ec362349c87e', 'bb47ac11-4d40-4429-9087-41d89860e39f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:55 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:39:55 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:55 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.229s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:39:55 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Deleted volume successfully. Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-a23ab93c-08b9-4037-bf04-8ff02bf19ac6 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-53cba574-6417-443a-81b0-6f7a07e59eba-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-833c00d5-c16f-4672-8172-aa9a9b8203ed-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-833c00d5-c16f-4672-8172-aa9a9b8203ed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "cinder-quobyte-833c00d5-c16f-4672-8172-aa9a9b8203ed" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-833c00d5-c16f-4672-8172-aa9a9b8203ed" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5408606-4b0a-4ce9-b8ee-a9d0843a61e4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:39:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:55 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed Sep 01 11:39:55 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:56 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed" returned: 0 in 0.331s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:56 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed Sep 01 11:39:56 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:56 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-833c00d5-c16f-4672-8172-aa9a9b8203ed" returned: 0 in 0.234s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-quobyte-833c00d5-c16f-4672-8172-aa9a9b8203ed" released by "delete_volume" :: held 0.598s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Created reservations ['008db163-4eec-4e59-a807-34de36c76a0f', 'e07ee9e8-95ab-4d6a-b68e-3d272e5f6224', '9a27418c-2ec8-481f-8710-89b1f16eb799', '4bedae68-7d00-4f71-9695-30df78335830'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:39:56 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:39:56 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:39:56 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.234s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:39:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Deleted volume successfully. Sep 01 11:39:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1fbc704-77af-4cb7-8c04-ec05a8131d89 tempest-SnapshotDependencyTests-399104255 None] Lock "cinder-833c00d5-c16f-4672-8172-aa9a9b8203ed-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:04 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:04 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:04 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.239s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:40:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:40:06 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=28,cinder:INSERT=8,cinder:SELECT=19,cinder:DELETE=3 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:40:06 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=28,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (38172eb0-ceb6-4008-b42a-006ca947e55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a1117d-06cc-4744-9d49-46d8f255613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a1117d-06cc-4744-9d49-46d8f255613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709829588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d1d10f-34b1-4fd1-b327-f2c434b4d551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:16Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363f4024-2cd6-4b9b-8c8a-6eeb5fe8de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363f4024-2cd6-4b9b-8c8a-6eeb5fe8de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3945f12a-6bae-4b3d-95ac-3b92e2f7e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3945f12a-6bae-4b3d-95ac-3b92e2f7e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d1d10f-34b1-4fd1-b327-f2c434b4d551', 'volume_name': 'volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74086d7c-31c4-4bde-9513-d949669525fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74086d7c-31c4-4bde-9513-d949669525fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fb5184-cca5-4a46-9f7e-cd0b790a8bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume a6d1d10f-34b1-4fd1-b327-f2c434b4d551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551', 'volume_size': 1} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709829588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d1d10f-34b1-4fd1-b327-f2c434b4d551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:16Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Creating volume a6d1d10f-34b1-4fd1-b327-f2c434b4d551 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:16 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:16 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 1073741824 Sep 01 11:40:16 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (a6ada80e-630d-49a8-a050-f9843060e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f2a16e-2a71-4a7f-b304-2647910ad641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f2a16e-2a71-4a7f-b304-2647910ad641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221145435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c081a19e-ca70-448f-ba4f-b880bc528c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:16Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2feaf91-4e7a-48c5-88e3-a2aec0956c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2feaf91-4e7a-48c5-88e3-a2aec0956c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff365a5-3054-4668-ad7c-f9e259882d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff365a5-3054-4668-ad7c-f9e259882d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c081a19e-ca70-448f-ba4f-b880bc528c0f', 'volume_name': 'volume-c081a19e-ca70-448f-ba4f-b880bc528c0f', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800a79bf-70e7-4439-ad28-a74b56a77e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800a79bf-70e7-4439-ad28-a74b56a77e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259d6fb5-3bfd-45a4-890c-678725092b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Volume c081a19e-ca70-448f-ba4f-b880bc528c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c081a19e-ca70-448f-ba4f-b880bc528c0f', 'volume_size': 1} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (5031d5fc-6b26-4c40-8a2a-f9a8f550c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a724e1-26c2-4e1e-9e90-f1c45aa21b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a724e1-26c2-4e1e-9e90-f1c45aa21b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070218662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:17Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a12448-1624-4c5a-bebf-70b46f936fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a12448-1624-4c5a-bebf-70b46f936fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c178a7-1c15-4796-bf41-d433096422af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c178a7-1c15-4796-bf41-d433096422af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c', 'volume_name': 'volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577588b5-e28c-4383-8a54-6d2fe49a4591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577588b5-e28c-4383-8a54-6d2fe49a4591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a93457-c46e-4d4e-a234-ad72083892e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Volume b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c', 'volume_size': 1} Sep 01 11:40:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:17 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 1073741824" returned: 0 in 0.670s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:17 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 Sep 01 11:40:17 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (3d70f036-1bf4-46a4-a36e-540b86eee956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560d0d5b-7daa-45c2-b2b9-9f6e8638367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560d0d5b-7daa-45c2-b2b9-9f6e8638367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810833527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f951dfe-9230-40c9-bb45-2c3e080a9d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:17Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1e3ed1-c4ec-40a2-b9a4-4ad8a414fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1e3ed1-c4ec-40a2-b9a4-4ad8a414fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188e7fe6-4fba-4558-aedd-efe1482d3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188e7fe6-4fba-4558-aedd-efe1482d3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f951dfe-9230-40c9-bb45-2c3e080a9d0b', 'volume_name': 'volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8316d583-bc40-48d4-8c47-d4cb00e7ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:17 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8316d583-bc40-48d4-8c47-d4cb00e7ce92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9175c7-32a9-4189-b92c-401a66bbcae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Volume 6f951dfe-9230-40c9-bb45-2c3e080a9d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b', 'volume_size': 1} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551" returned: 0 in 0.411s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221145435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c081a19e-ca70-448f-ba4f-b880bc528c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:16Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Creating volume c081a19e-ca70-448f-ba4f-b880bc528c0f {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:17 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:17 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f 1073741824 Sep 01 11:40:17 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fb5184-cca5-4a46-9f7e-cd0b790a8bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c27bbae-61b5-4b51-acb1-452515cece1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:17 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 (a6d1d10f-34b1-4fd1-b327-f2c434b4d551): created successfully Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c27bbae-61b5-4b51-acb1-452515cece1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (38172eb0-ceb6-4008-b42a-006ca947e55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:17 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2bbee429-5bcb-4580-869c-11b850d987e7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created volume successfully. Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (7585ad46-e793-463e-8532-fda5ac814f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:17 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99ad3bb-83c6-47ed-b59e-f3636cf6e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99ad3bb-83c6-47ed-b59e-f3636cf6e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435141468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fcd007-e5db-4f1a-9bc3-b163a841b55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:18Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbfa323-7a1f-4d64-9c50-3fe805e09313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbfa323-7a1f-4d64-9c50-3fe805e09313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf454f7-3e46-453e-b2b8-55857996909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf454f7-3e46-453e-b2b8-55857996909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fcd007-e5db-4f1a-9bc3-b163a841b55e', 'volume_name': 'volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2f0525-3050-4f1b-aa6f-668bbcb0c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2f0525-3050-4f1b-aa6f-668bbcb0c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a429b1a9-f223-4414-a0b5-943adccf4d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Volume 87fcd007-e5db-4f1a-9bc3-b163a841b55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e', 'volume_size': 1} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:18 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f 1073741824" returned: 0 in 0.626s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:18 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f Sep 01 11:40:18 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (b3d37d31-82cb-4e41-9347-c91da880ce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee316ec-7f9d-4c43-b564-0d3ff48d3093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee316ec-7f9d-4c43-b564-0d3ff48d3093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1867407988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f328348-e376-4612-9e70-11056eb0645a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:19Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449fdb11-5438-48f4-b5cc-2b03213c1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449fdb11-5438-48f4-b5cc-2b03213c1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2479a895-244f-44d6-9eec-619990985ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2479a895-244f-44d6-9eec-619990985ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f328348-e376-4612-9e70-11056eb0645a', 'volume_name': 'volume-0f328348-e376-4612-9e70-11056eb0645a', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd15efbc-3284-41fd-8fec-f05a45ec4d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd15efbc-3284-41fd-8fec-f05a45ec4d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363def4f-fa6a-4474-bd8e-8028571ebf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Volume 0f328348-e376-4612-9e70-11056eb0645a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f328348-e376-4612-9e70-11056eb0645a', 'volume_size': 1} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f" returned: 0 in 0.485s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070218662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:17Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Creating volume b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:18 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259d6fb5-3bfd-45a4-890c-678725092b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c081a19e-ca70-448f-ba4f-b880bc528c0f', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32c2c94-2097-4956-87f7-53f3558bc696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:18 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c 1073741824 Sep 01 11:40:18 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:18 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Volume volume-c081a19e-ca70-448f-ba4f-b880bc528c0f (c081a19e-ca70-448f-ba4f-b880bc528c0f): created successfully Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32c2c94-2097-4956-87f7-53f3558bc696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:18 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (a6ada80e-630d-49a8-a050-f9843060e98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-be81028a-3b06-4ed7-9c17-5176b5f022a2 tempest-CreateVolumesFromImageTest-266948030 None] Created volume successfully. Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (b91832b6-2d24-4fd2-b208-bbab4fb784a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36424c5-cfb1-42cd-a499-d57c9c590dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36424c5-cfb1-42cd-a499-d57c9c590dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930415917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426acd28-a1b1-4342-b048-fc826ac91a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:19Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b2f677-3763-4119-9260-7ae63bb5c18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b2f677-3763-4119-9260-7ae63bb5c18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94676938-84c9-4585-9bc3-884137b025aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94676938-84c9-4585-9bc3-884137b025aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426acd28-a1b1-4342-b048-fc826ac91a12', 'volume_name': 'volume-426acd28-a1b1-4342-b048-fc826ac91a12', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea78b33-9610-495b-b380-4d1b6be1a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea78b33-9610-495b-b380-4d1b6be1a6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cc8b3f-1fb8-4e79-a6bb-4bf11d7cb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume 426acd28-a1b1-4342-b048-fc826ac91a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426acd28-a1b1-4342-b048-fc826ac91a12', 'volume_size': 1} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:19 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c 1073741824" returned: 0 in 0.721s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:19 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c Sep 01 11:40:19 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (0f834a57-92b2-475d-95b0-060eac5c6ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f5e88c-1e9f-4e72-ac87-95de1588bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f5e88c-1e9f-4e72-ac87-95de1588bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988268916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bfe26d-a09d-4c25-a7b6-e4b08fa4f831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:20Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9502f75a-b3d1-4baf-b7e4-3b9221c91cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9502f75a-b3d1-4baf-b7e4-3b9221c91cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6bdc00-65cc-4803-ae49-4a39f4809902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6bdc00-65cc-4803-ae49-4a39f4809902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bfe26d-a09d-4c25-a7b6-e4b08fa4f831', 'volume_name': 'volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80254e76-0b09-47c3-aed6-5f8ff2fe92d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80254e76-0b09-47c3-aed6-5f8ff2fe92d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ff3574-7e51-4005-a836-a978e9c3d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:19 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume 45bfe26d-a09d-4c25-a7b6-e4b08fa4f831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831', 'volume_size': 1} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:19 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c" returned: 0 in 0.420s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.413s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810833527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f951dfe-9230-40c9-bb45-2c3e080a9d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:17Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Creating volume 6f951dfe-9230-40c9-bb45-2c3e080a9d0b {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:19 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a93457-c46e-4d4e-a234-ad72083892e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b 1073741824 Sep 01 11:40:20 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866ff395-085c-45a1-86bc-9a29cffa6112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Volume volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c (b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c): created successfully Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866ff395-085c-45a1-86bc-9a29cffa6112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (5031d5fc-6b26-4c40-8a2a-f9a8f550c359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:20 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9d5527c4-6473-4a4b-966a-dd1608659076 tempest-CreateVolumesFromImageTest-266948030 None] Created volume successfully. Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (c1995f51-36f2-48ce-a553-f3988d5c7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2444f7b9-8dfe-4179-a494-04263a1b76f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2444f7b9-8dfe-4179-a494-04263a1b76f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784188311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9eddf9f-afad-456c-a545-a732d3463e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:20Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99281adf-a720-41c7-9789-7d79a35a5567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99281adf-a720-41c7-9789-7d79a35a5567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b361c97e-818a-4554-9c7d-6f1577d4c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b361c97e-818a-4554-9c7d-6f1577d4c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9eddf9f-afad-456c-a545-a732d3463e3c', 'volume_name': 'volume-a9eddf9f-afad-456c-a545-a732d3463e3c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd92790-fabb-482f-96d2-f432ca9c07c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd92790-fabb-482f-96d2-f432ca9c07c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3b7ffa-6ff1-4691-b810-29e45d29d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume a9eddf9f-afad-456c-a545-a732d3463e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9eddf9f-afad-456c-a545-a732d3463e3c', 'volume_size': 1} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:20 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (c5c2ca8b-fa1e-481f-9c50-9fbb655f50dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99530da5-e696-4254-a38d-e8aac76b1075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b 1073741824" returned: 0 in 0.774s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99530da5-e696-4254-a38d-e8aac76b1075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762626874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66ef721-9201-4720-892b-6bde4f90e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:21Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dcedad-b4b2-4c71-a97b-945c48c53f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dcedad-b4b2-4c71-a97b-945c48c53f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03d38fd-80dc-4125-bf12-a62831d420d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03d38fd-80dc-4125-bf12-a62831d420d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66ef721-9201-4720-892b-6bde4f90e3fa', 'volume_name': 'volume-d66ef721-9201-4720-892b-6bde4f90e3fa', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6372074-3c11-4eff-91f2-9a55bf954e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6372074-3c11-4eff-91f2-9a55bf954e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60481a8-5677-4464-838c-30b18e0371f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:20 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume d66ef721-9201-4720-892b-6bde4f90e3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66ef721-9201-4720-892b-6bde4f90e3fa', 'volume_size': 1} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:20 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b Sep 01 11:40:20 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (68e55fc7-8d1f-4215-9a88-4a6777b023d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe2f31f-2fa1-43e4-a30e-bb2918187a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe2f31f-2fa1-43e4-a30e-bb2918187a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393245988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:21Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb01b4b9-a7fb-44a8-a73c-1435077a113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb01b4b9-a7fb-44a8-a73c-1435077a113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a11fa3a-2f4d-4505-95e3-dcab7c8f91dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a11fa3a-2f4d-4505-95e3-dcab7c8f91dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf', 'volume_name': 'volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f251a35-290d-4722-ae07-5068e244b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f251a35-290d-4722-ae07-5068e244b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c90c358-44bd-4634-ae46-ec782b85d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf', 'volume_size': 1} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b" returned: 0 in 0.376s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.210s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435141468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fcd007-e5db-4f1a-9bc3-b163a841b55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:18Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Creating volume 87fcd007-e5db-4f1a-9bc3-b163a841b55e {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:21 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9175c7-32a9-4189-b92c-401a66bbcae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb17b3e5-3bd1-4ff0-b507-8fb6f8efaec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e 1073741824 Sep 01 11:40:21 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:21 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Volume volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b (6f951dfe-9230-40c9-bb45-2c3e080a9d0b): created successfully Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb17b3e5-3bd1-4ff0-b507-8fb6f8efaec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (3d70f036-1bf4-46a4-a36e-540b86eee956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-20b16517-8702-477e-84f9-a99245403c5b tempest-CreateVolumesFromImageTest-266948030 None] Created volume successfully. Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Flow 'volume_create_manager' (b5dfe1eb-4b2d-436d-b234-2e3f30705b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a5d6a1-afa6-41f7-a407-fbb67a64fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a5d6a1-afa6-41f7-a407-fbb67a64fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7da4fc6-0c35-4f76-8a5a-90146b114327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78293fe342e7411a82cedb383c1a86a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:22Z,use_quota=True,user_id='e786199d4cd545748d121995217a063e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf00524b-359b-4ee3-ba05-2de289bf5be0),volume_type_id=bf00524b-359b-4ee3-ba05-2de289bf5be0)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7b14a2-00f8-426b-a6c3-101625731ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7b14a2-00f8-426b-a6c3-101625731ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cfe2a0-c4b2-4d41-89c3-fec47cd23d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e 1073741824" returned: 0 in 0.554s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:21 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e Sep 01 11:40:21 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:22 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e" returned: 0 in 0.293s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.479s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1867407988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f328348-e376-4612-9e70-11056eb0645a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27057f663a1a4d6fb9d82ea793188ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:19Z,use_quota=True,user_id='2703094a8c64483d860392f1b3e718d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Creating volume 0f328348-e376-4612-9e70-11056eb0645a {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:22 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a429b1a9-f223-4414-a0b5-943adccf4d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cb5cfd-4e91-463f-a47c-ac74f53e0efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:22 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a 1073741824 Sep 01 11:40:22 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Volume volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e (87fcd007-e5db-4f1a-9bc3-b163a841b55e): created successfully Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cb5cfd-4e91-463f-a47c-ac74f53e0efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (7585ad46-e793-463e-8532-fda5ac814f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cfe2a0-c4b2-4d41-89c3-fec47cd23d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7da4fc6-0c35-4f76-8a5a-90146b114327', 'volume_name': 'volume-c7da4fc6-0c35-4f76-8a5a-90146b114327', 'volume_size': 1, 'image_id': '2572af9e-56ff-465e-9958-ba91986b5670', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2572af9e-56ff-465e-9958-ba91986b5670', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0815d4f5e14d660717a90ea1aec394f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78293fe342e7411a82cedb383c1a86a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca00e57c1b66ca4ac5458aa91a1cf206bb7e36487cacfa0841657c32021aff96ec8355bbb65e300460b8a4d32e00c27209b2617517c7f0faaec3ad4cf839b15f', 'id': '2572af9e-56ff-465e-9958-ba91986b5670', 'created_at': datetime.datetime(2026, 9, 1, 9, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 40, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2572af9e-56ff-465e-9958-ba91986b5670/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7484851a-d00f-4c6b-a634-032deaa6745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7484851a-d00f-4c6b-a634-032deaa6745a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d9d174-9586-4431-8b92-921f75f3a648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Volume c7da4fc6-0c35-4f76-8a5a-90146b114327: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7da4fc6-0c35-4f76-8a5a-90146b114327', 'volume_size': 1, 'image_id': '2572af9e-56ff-465e-9958-ba91986b5670', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2572af9e-56ff-465e-9958-ba91986b5670', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0815d4f5e14d660717a90ea1aec394f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78293fe342e7411a82cedb383c1a86a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca00e57c1b66ca4ac5458aa91a1cf206bb7e36487cacfa0841657c32021aff96ec8355bbb65e300460b8a4d32e00c27209b2617517c7f0faaec3ad4cf839b15f', 'id': '2572af9e-56ff-465e-9958-ba91986b5670', 'created_at': datetime.datetime(2026, 9, 1, 9, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 40, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2572af9e-56ff-465e-9958-ba91986b5670/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Trying to clone c7da4fc6-0c35-4f76-8a5a-90146b114327 from image 2572af9e-56ff-465e-9958-ba91986b5670 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2572af9e-56ff-465e-9958-ba91986b5670', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:40:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5468d3a8-0e0e-45df-b8cf-412e4e58877a tempest-CreateVolumesFromImageTest-266948030 None] Created volume successfully. Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:40:22 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Image download 0.00 MB at 0.00 MB/s Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[acabe675-cec7-4da4-a5e0-c47f957978ea]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:22 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD Sep 01 11:40:22 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:22 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a 1073741824" returned: 0 in 0.498s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:22 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a Sep 01 11:40:22 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:22 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:22 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD Sep 01 11:40:22 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:22 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a" returned: 0 in 0.255s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.748s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930415917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426acd28-a1b1-4342-b048-fc826ac91a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:19Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Creating volume 426acd28-a1b1-4342-b048-fc826ac91a12 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:23 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363def4f-fa6a-4474-bd8e-8028571ebf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f328348-e376-4612-9e70-11056eb0645a', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:23 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 1073741824 Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497521a4-31dc-499a-b060-a7512bcbf872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:23 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Volume volume-0f328348-e376-4612-9e70-11056eb0645a (0f328348-e376-4612-9e70-11056eb0645a): created successfully Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497521a4-31dc-499a-b060-a7512bcbf872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Flow 'volume_create_manager' (b3d37d31-82cb-4e41-9347-c91da880ce87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8bb9aec2-2df6-462a-a8ed-2f61358244bb tempest-CreateVolumesFromImageTest-266948030 None] Created volume successfully. Sep 01 11:40:23 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Temporary image 2572af9e-56ff-465e-9958-ba91986b5670 is fetched for user e786199d4cd545748d121995217a063e. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa0b333-98d5-45b3-b495-3f53f25efdaf]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-0f328348-e376-4612-9e70-11056eb0645a-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-0f328348-e376-4612-9e70-11056eb0645a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-quobyte-0f328348-e376-4612-9e70-11056eb0645a" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-0f328348-e376-4612-9e70-11056eb0645a" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e4b3e7-6de2-4a30-b974-addedf077951]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:23 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD Sep 01 11:40:23 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:23 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a Sep 01 11:40:23 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:23 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 1073741824" returned: 0 in 0.655s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:23 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 Sep 01 11:40:23 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:23 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:23 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD Sep 01 11:40:23 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:23 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:23 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a Sep 01 11:40:23 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:23 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.212s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988268916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bfe26d-a09d-4c25-a7b6-e4b08fa4f831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:20Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Creating volume 45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:23 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cc8b3f-1fb8-4e79-a6bb-4bf11d7cb994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426acd28-a1b1-4342-b048-fc826ac91a12', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:24 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 1073741824 Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3cfa7c-85e7-4804-82fe-a9da87951267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:24 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:24 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume volume-426acd28-a1b1-4342-b048-fc826ac91a12 (426acd28-a1b1-4342-b048-fc826ac91a12): created successfully Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3cfa7c-85e7-4804-82fe-a9da87951267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (b91832b6-2d24-4fd2-b208-bbab4fb784a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e9bb9f52-abf5-4bbb-8054-50470416110e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created volume successfully. Sep 01 11:40:24 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:24 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-0f328348-e376-4612-9e70-11056eb0645a" returned: 0 in 0.264s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-0f328348-e376-4612-9e70-11056eb0645a" released by "delete_volume" :: held 0.722s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Created reservations ['feb9ecea-0058-48c3-a1ce-bdfd861cdc95', 'eee1f436-d75a-4c54-ab96-44bb2448f166', '0cb2a584-7603-4589-a83d-3bb6406a5040', 'e905f9fb-4e79-4480-b761-368afde2d4a0'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:24 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:24 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:24 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 1073741824" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-87fcd007-e5db-4f1a-9bc3-b163a841b55e-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-87fcd007-e5db-4f1a-9bc3-b163a841b55e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:24 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 Sep 01 11:40:24 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:24 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-quobyte-87fcd007-e5db-4f1a-9bc3-b163a841b55e" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Deleted volume successfully. Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-87fcd007-e5db-4f1a-9bc3-b163a841b55e" acquired by "delete_volume" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-387a7f2b-67d9-4ab1-a2e3-89e1e31d6f78 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-0f328348-e376-4612-9e70-11056eb0645a-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505230c-51d9-4e86-a2cc-0209f1e0eff3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:24 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e Sep 01 11:40:24 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:24 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.542s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784188311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9eddf9f-afad-456c-a545-a732d3463e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:20Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Creating volume a9eddf9f-afad-456c-a545-a732d3463e3c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:24 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ff3574-7e51-4005-a836-a978e9c3d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:24 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c 1073741824 Sep 01 11:40:24 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09adf9dc-f880-4006-aa49-ead732c24460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:24 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 (45bfe26d-a09d-4c25-a7b6-e4b08fa4f831): created successfully Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09adf9dc-f880-4006-aa49-ead732c24460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (0f834a57-92b2-475d-95b0-060eac5c6ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3a6c3fac-4619-463a-9c62-054791505d0f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created volume successfully. Sep 01 11:40:25 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e" returned: 0 in 0.439s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:25 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e Sep 01 11:40:25 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:25 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c 1073741824" returned: 0 in 0.474s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:25 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-87fcd007-e5db-4f1a-9bc3-b163a841b55e" returned: 0 in 0.299s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:25 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c Sep 01 11:40:25 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-87fcd007-e5db-4f1a-9bc3-b163a841b55e" released by "delete_volume" :: held 0.798s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Created reservations ['0d9a1df1-cb89-4fa1-9022-cd03e70cb265', 'd4d244f3-4e8b-4451-93cd-bcd7c1e51a08', '608358fc-9eda-4395-884f-7b984e94406b', 'f5bf3103-c304-4a2d-94de-4accf987a54c'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:25 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:25 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:25 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-6f951dfe-9230-40c9-bb45-2c3e080a9d0b-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c" returned: 0 in 0.367s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.905s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762626874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66ef721-9201-4720-892b-6bde4f90e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:21Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Creating volume d66ef721-9201-4720-892b-6bde4f90e3fa {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:25 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:25 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa 1073741824 Sep 01 11:40:25 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-6f951dfe-9230-40c9-bb45-2c3e080a9d0b-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3b7ffa-6ff1-4691-b810-29e45d29d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9eddf9f-afad-456c-a545-a732d3463e3c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765bc473-ddbd-4bed-8cee-53705892f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:25 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume volume-a9eddf9f-afad-456c-a545-a732d3463e3c (a9eddf9f-afad-456c-a545-a732d3463e3c): created successfully Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765bc473-ddbd-4bed-8cee-53705892f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (c1995f51-36f2-48ce-a553-f3988d5c7611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0cbeb464-b33d-485f-8a65-a378188d10e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created volume successfully. Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-quobyte-6f951dfe-9230-40c9-bb45-2c3e080a9d0b" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:25 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.344s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-6f951dfe-9230-40c9-bb45-2c3e080a9d0b" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:25 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Deleted volume successfully. Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e513b5ad-1c02-403b-ac57-793c0200acd4 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-87fcd007-e5db-4f1a-9bc3-b163a841b55e-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf0339-d2ab-4a0a-a972-f72eaea7239a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:26 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b Sep 01 11:40:26 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:26 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa 1073741824" returned: 0 in 0.444s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:26 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa Sep 01 11:40:26 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:26 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b" returned: 0 in 0.388s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:26 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b Sep 01 11:40:26 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:26 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.243s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393245988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf606fc47e341e4a789c7bb9e0dd6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:21Z,use_quota=True,user_id='cbcd0830413a41959ac9ff292af05028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Creating volume f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:26 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:26 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf 1073741824 Sep 01 11:40:26 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60481a8-5677-4464-838c-30b18e0371f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66ef721-9201-4720-892b-6bde4f90e3fa', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8939a322-f7fa-4ced-92f4-d2705ef13bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:26 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume volume-d66ef721-9201-4720-892b-6bde4f90e3fa (d66ef721-9201-4720-892b-6bde4f90e3fa): created successfully Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8939a322-f7fa-4ced-92f4-d2705ef13bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (c5c2ca8b-fa1e-481f-9c50-9fbb655f50dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-24360b25-af0d-416e-8501-3c2d0442130f tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created volume successfully. Sep 01 11:40:26 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-6f951dfe-9230-40c9-bb45-2c3e080a9d0b" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-6f951dfe-9230-40c9-bb45-2c3e080a9d0b" released by "delete_volume" :: held 0.716s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Created reservations ['8e82af3a-0026-4d50-9f1f-907d2f5107a4', '8fb9a46f-89b5-4c54-b1b3-19131f780c5c', 'e0b307e4-31bb-4f3a-9dac-b7d9e17ca9db', '38aaeab2-99eb-471d-b7a5-922896e20fb9'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:26 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:26 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-quobyte-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:27 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.319s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2727f0be-ed78-4ad0-a00f-4dbb4bb8d8c4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Deleted volume successfully. Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-813aea13-7bdd-4a35-ac86-d2d51ebf2c6a tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-6f951dfe-9230-40c9-bb45-2c3e080a9d0b-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:27 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf 1073741824" returned: 0 in 0.638s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:27 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c Sep 01 11:40:27 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:27 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf Sep 01 11:40:27 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:27 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.367s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7da4fc6-0c35-4f76-8a5a-90146b114327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78293fe342e7411a82cedb383c1a86a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:22Z,use_quota=True,user_id='e786199d4cd545748d121995217a063e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf00524b-359b-4ee3-ba05-2de289bf5be0),volume_type_id=bf00524b-359b-4ee3-ba05-2de289bf5be0)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Creating volume c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:27 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:27 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c" returned: 0 in 0.438s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:27 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 1073741824 Sep 01 11:40:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c Sep 01 11:40:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:27 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c90c358-44bd-4634-ae46-ec782b85d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d39891-da01-42d4-99af-1f9ca68cdd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:27 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Volume volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf (f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf): created successfully Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d39891-da01-42d4-99af-1f9ca68cdd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Flow 'volume_create_manager' (68e55fc7-8d1f-4215-9a88-4a6777b023d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-667ef671-2b00-46a9-af0f-84796638268e tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created volume successfully. Sep 01 11:40:27 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c" returned: 0 in 0.382s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c" released by "delete_volume" :: held 0.888s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-quobyte-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Created reservations ['ff623f8d-d092-4a36-bd56-0a8bb86d77b3', '32c981d7-cb8b-4008-9a7e-92282bddfea8', '4d6cd068-4e00-4a31-8c13-897f34e673c6', '261cf9d5-fef4-4d10-a741-a995fb7e9714'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f44c5-19a1-4d33-bee2-e882907495d5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:28 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 1073741824" returned: 0 in 0.686s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:28 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:28 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:28 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf Sep 01 11:40:28 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:28 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:28 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:28 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:28 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Deleted volume successfully. Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-696b8942-58cd-46af-9086-d1d39d54233c tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-b7aec0dd-2bfe-4fb0-96ff-b0dfd2bdda0c-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:28 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 0 in 0.301s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:28 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf" returned: 0 in 0.489s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Attempting download of 2572af9e-56ff-465e-9958-ba91986b5670 ((None, [{'url': 'file:///opt/stack/data/glance/images/2572af9e-56ff-465e-9958-ba91986b5670', 'metadata': {}}])) to volume c7da4fc6-0c35-4f76-8a5a-90146b114327. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:40:28 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf Sep 01 11:40:28 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56a604b-71f8-4b4f-8d65-2762055635b5]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:28 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn Sep 01 11:40:28 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:28 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf" released by "delete_volume" :: held 0.811s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:28 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created reservations ['1cdccae2-4f57-44d4-b924-8e39f4f6b412', '98b0627a-92a9-48db-9300-214309c65897', 'b5541341-03c4-4bf1-9daf-ace5b056ce41', '81f39146-ad2b-4271-809c-82f368608741'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:29 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-d66ef721-9201-4720-892b-6bde4f90e3fa-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:29 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-d66ef721-9201-4720-892b-6bde4f90e3fa-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:29 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-quobyte-d66ef721-9201-4720-892b-6bde4f90e3fa" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-c081a19e-ca70-448f-ba4f-b880bc528c0f-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-d66ef721-9201-4720-892b-6bde4f90e3fa" acquired by "delete_volume" :: waited 0.052s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-c081a19e-ca70-448f-ba4f-b880bc528c0f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63d29f-ccaf-490d-a94a-6acb11699af2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.429s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Deleted volume successfully. Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "cinder-quobyte-c081a19e-ca70-448f-ba4f-b880bc528c0f" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e8234ab8-4f17-4368-a2c0-bbb6d6e7681d tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-f7997c5e-f39e-41e2-8e01-f19ed1d1f4bf-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:29 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn" returned: 1 in 0.467s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2572af9e-56ff-465e-9958-ba91986b5670_hbfvt_gn' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[920a6b35-db04-42d4-8b89-1a5d56a42c2d]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-c081a19e-ca70-448f-ba4f-b880bc528c0f" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:29 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa Sep 01 11:40:29 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a801f3-1476-4390-98c2-44f3bcbb6c8d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD Sep 01 11:40:29 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:29 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f Sep 01 11:40:29 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:29 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa" returned: 0 in 0.448s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:29 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa Sep 01 11:40:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:29 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f" returned: 0 in 0.452s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:30 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD Sep 01 11:40:30 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f Sep 01 11:40:30 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d66ef721-9201-4720-892b-6bde4f90e3fa" returned: 0 in 0.308s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-d66ef721-9201-4720-892b-6bde4f90e3fa" released by "delete_volume" :: held 0.835s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created reservations ['1ec56915-0571-40b9-8e1b-a033f979842c', 'ab091734-e5d9-4be4-88c2-e2ce53c38297', '91c80fe4-4833-43b5-8e40-95b73daabbf7', '029ccedb-a153-45c6-a4a4-9450a5006bd0'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:30 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] 2572af9e-56ff-465e-9958-ba91986b5670 was raw, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c081a19e-ca70-448f-ba4f-b880bc528c0f" returned: 0 in 0.333s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:30 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-quobyte-c081a19e-ca70-448f-ba4f-b880bc528c0f" released by "delete_volume" :: held 0.835s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Created reservations ['c218dcae-4d11-44e1-a414-827075816fe6', '0df09ef4-202b-4c1e-b35a-28808b4dcae9', 'eaa221e3-de4f-4b80-ac47-fb1d9366152f', '388cec51-6114-443a-8b06-be238338b336'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:30 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:30 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:30 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:30 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 0 in 0.395s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2572af9e-56ff-465e-9958-ba91986b5670_0bj8epyhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:40:30 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:30 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 1G Sep 01 11:40:30 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Deleted volume successfully. Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-9f65cc2b-e616-456c-8eba-1521e130c693 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-d66ef721-9201-4720-892b-6bde4f90e3fa-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:30 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.285s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:30 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Deleted volume successfully. Sep 01 11:40:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8c64529a-7608-4bbc-b8df-325fbcd8cc73 tempest-CreateVolumesFromImageTest-266948030 None] Lock "cinder-c081a19e-ca70-448f-ba4f-b880bc528c0f-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:31 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 1G" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e0b5b1-a300-4172-b1c1-08c701f6b65d]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:31 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:31 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:31 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 0 in 0.371s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-a9eddf9f-afad-456c-a545-a732d3463e3c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-a9eddf9f-afad-456c-a545-a732d3463e3c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-quobyte-a9eddf9f-afad-456c-a545-a732d3463e3c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-a9eddf9f-afad-456c-a545-a732d3463e3c" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f55f73-3270-497d-a6a8-246147e8f89b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:31 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:31 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:31 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c Sep 01 11:40:31 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:31 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 1 in 0.482s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Downloaded image 2572af9e-56ff-465e-9958-ba91986b5670 ((None, [{'url': 'file:///opt/stack/data/glance/images/2572af9e-56ff-465e-9958-ba91986b5670', 'metadata': {}}])) to volume c7da4fc6-0c35-4f76-8a5a-90146b114327 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Temporary image 2572af9e-56ff-465e-9958-ba91986b5670 for user e786199d4cd545748d121995217a063e is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Marking volume c7da4fc6-0c35-4f76-8a5a-90146b114327 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Copying metadata from image 2572af9e-56ff-465e-9958-ba91986b5670 to c7da4fc6-0c35-4f76-8a5a-90146b114327. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:40:31 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Creating volume glance metadata for volume c7da4fc6-0c35-4f76-8a5a-90146b114327 backed by image 2572af9e-56ff-465e-9958-ba91986b5670 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2572af9e-56ff-465e-9958-ba91986b5670', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0815d4f5e14d660717a90ea1aec394f9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d9d174-9586-4431-8b92-921f75f3a648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7da4fc6-0c35-4f76-8a5a-90146b114327', 'volume_size': 1, 'image_id': '2572af9e-56ff-465e-9958-ba91986b5670', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2572af9e-56ff-465e-9958-ba91986b5670', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0815d4f5e14d660717a90ea1aec394f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78293fe342e7411a82cedb383c1a86a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca00e57c1b66ca4ac5458aa91a1cf206bb7e36487cacfa0841657c32021aff96ec8355bbb65e300460b8a4d32e00c27209b2617517c7f0faaec3ad4cf839b15f', 'id': '2572af9e-56ff-465e-9958-ba91986b5670', 'created_at': datetime.datetime(2026, 9, 1, 9, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 40, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2572af9e-56ff-465e-9958-ba91986b5670/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0a497d-ff90-461c-bbdf-b061acd6f68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Volume volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 (c7da4fc6-0c35-4f76-8a5a-90146b114327): created successfully Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0a497d-ff90-461c-bbdf-b061acd6f68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Flow 'volume_create_manager' (b5dfe1eb-4b2d-436d-b234-2e3f30705b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:32 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c" returned: 0 in 0.530s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b338b374-aa4b-47c3-8f94-d6f9de6efe6d tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Created volume successfully. Sep 01 11:40:32 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c Sep 01 11:40:32 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Flow 'volume_create_manager' (234ddb6d-4663-4eb7-a8db-bc4f3c4a06a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f676ce-5c36-4cb7-8999-aeeea2e1b019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f676ce-5c36-4cb7-8999-aeeea2e1b019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006229806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932ac18e-0464-40b1-8212-91ea1e876ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1e5b5aabaf40478aa15c0c9f87c0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:32Z,use_quota=True,user_id='d88d64876bb049f9b86eb99b50fd2c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50457b1-e0fa-4da1-84f6-2095d80a4e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50457b1-e0fa-4da1-84f6-2095d80a4e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2465c28f-4678-44c2-b83d-2e1cf01c2403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2465c28f-4678-44c2-b83d-2e1cf01c2403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932ac18e-0464-40b1-8212-91ea1e876ee2', 'volume_name': 'volume-932ac18e-0464-40b1-8212-91ea1e876ee2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6bbc84-8c2c-4893-901c-00e3213c6c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6bbc84-8c2c-4893-901c-00e3213c6c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4701b1b-6c40-46e8-955f-56f3d333cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Volume 932ac18e-0464-40b1-8212-91ea1e876ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932ac18e-0464-40b1-8212-91ea1e876ee2', 'volume_size': 1} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006229806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932ac18e-0464-40b1-8212-91ea1e876ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1e5b5aabaf40478aa15c0c9f87c0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:32Z,use_quota=True,user_id='d88d64876bb049f9b86eb99b50fd2c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Creating volume 932ac18e-0464-40b1-8212-91ea1e876ee2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:32 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:32 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 1073741824 Sep 01 11:40:32 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:32 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9eddf9f-afad-456c-a545-a732d3463e3c" returned: 0 in 0.284s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-a9eddf9f-afad-456c-a545-a732d3463e3c" released by "delete_volume" :: held 0.884s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created reservations ['7c34455b-d8f5-4c9b-b8d7-4fdb37b6f512', 'c1bbde85-8db9-4498-810c-38ac0af80ae1', '912de044-b6ea-4cfd-8f05-431ab6ca4763', 'b27cccf9-1169-4d8e-abcd-55ef0c4b7b3a'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Acquiring lock "cinder-c7da4fc6-0c35-4f76-8a5a-90146b114327-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "cinder-c7da4fc6-0c35-4f76-8a5a-90146b114327-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Acquiring lock "cinder-quobyte-c7da4fc6-0c35-4f76-8a5a-90146b114327" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "cinder-quobyte-c7da4fc6-0c35-4f76-8a5a-90146b114327" acquired by "delete_volume" :: waited 0.051s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:32 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:32 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5dbcb-efec-4911-a962-e0afba919917]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-quobyte-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:32 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 1073741824" returned: 0 in 0.706s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f24640e-6819-4f72-bdd5-19d428c98bfe]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:33 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:33 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:33 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.365s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Deleted volume successfully. Sep 01 11:40:33 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 Sep 01 11:40:33 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-09690a17-2990-466c-82bb-d6315dfd50b8 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-a9eddf9f-afad-456c-a545-a732d3463e3c-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:33 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 Sep 01 11:40:33 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2" returned: 0 in 0.330s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4701b1b-6c40-46e8-955f-56f3d333cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932ac18e-0464-40b1-8212-91ea1e876ee2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:33 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c341ca2d-e413-48b2-9818-4d94e330a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 0 in 0.562s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:33 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Volume volume-932ac18e-0464-40b1-8212-91ea1e876ee2 (932ac18e-0464-40b1-8212-91ea1e876ee2): created successfully Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c341ca2d-e413-48b2-9818-4d94e330a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Flow 'volume_create_manager' (234ddb6d-4663-4eb7-a8db-bc4f3c4a06a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a510baee-bca6-49d4-b917-3c2f7a9b3adf tempest-ProjectReaderTests-1690119986 None] Created volume successfully. Sep 01 11:40:33 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831" returned: 0 in 0.494s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:33 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831 Sep 01 11:40:33 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:33 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831" released by "delete_volume" :: held 0.850s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:33 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 1 in 0.377s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:33 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327 Sep 01 11:40:33 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created reservations ['6a792e3b-b2ed-4533-95d3-c57b542a037a', '24cda7cf-e906-4a33-89ba-a22d895e3510', '0363ae33-65ef-4c0d-8485-f80606acb0c6', '2fbc097e-bf99-4793-a077-62d474ac5965'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:33 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:33 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-426acd28-a1b1-4342-b048-fc826ac91a12-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-426acd28-a1b1-4342-b048-fc826ac91a12-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:34 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c7da4fc6-0c35-4f76-8a5a-90146b114327" returned: 0 in 0.310s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-quobyte-426acd28-a1b1-4342-b048-fc826ac91a12" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "cinder-quobyte-c7da4fc6-0c35-4f76-8a5a-90146b114327" released by "delete_volume" :: held 1.410s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-426acd28-a1b1-4342-b048-fc826ac91a12" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e5f6b9-f70c-4465-936f-db8f223c8f40]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Created reservations ['4284fd01-cf9e-441d-80f7-6cecb15d575a', '5434815f-d5c9-4196-9b08-2536a9255546', 'e83d47be-9fc5-4744-a264-24106f9b72d7', '2475e8db-34d2-44b3-9343-c368f46374f6'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:34 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.341s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:34 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Deleted volume successfully. Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-2b995d75-7097-4f18-824a-d3e2bac2c405 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-45bfe26d-a09d-4c25-a7b6-e4b08fa4f831-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:34 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 Sep 01 11:40:34 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:34 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:34 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:34 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Acquiring lock "cinder-932ac18e-0464-40b1-8212-91ea1e876ee2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12" returned: 0 in 0.441s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:34 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Lock "cinder-932ac18e-0464-40b1-8212-91ea1e876ee2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:34 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12 Sep 01 11:40:34 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:34 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Deleted volume successfully. Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3b669dcf-f021-41d6-b79f-a0971eb521f4 tempest-VolumeAndVolumeTypeFromImageTest-748972239 None] Lock "cinder-c7da4fc6-0c35-4f76-8a5a-90146b114327-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Acquiring lock "cinder-quobyte-932ac18e-0464-40b1-8212-91ea1e876ee2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Lock "cinder-quobyte-932ac18e-0464-40b1-8212-91ea1e876ee2" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f43ad-0248-47cd-977d-f493d9f63787]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:34 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 Sep 01 11:40:34 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-426acd28-a1b1-4342-b048-fc826ac91a12" returned: 0 in 0.320s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-426acd28-a1b1-4342-b048-fc826ac91a12" released by "delete_volume" :: held 0.830s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created reservations ['fa8d4f48-06e0-4b14-8ecd-07f9805008cc', '7dcf082d-bd84-4587-a469-0d073aa2754c', 'f2f0dfa0-be1d-4320-9d2a-d5275296237f', 'f3693cec-abc8-48b9-8b4a-094c0423ae17'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:35 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:35 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:35 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2" returned: 0 in 0.485s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-a6d1d10f-34b1-4fd1-b327-f2c434b4d551-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:35 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2 Sep 01 11:40:35 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-a6d1d10f-34b1-4fd1-b327-f2c434b4d551-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "cinder-quobyte-a6d1d10f-34b1-4fd1-b327-f2c434b4d551" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:35 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.325s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-a6d1d10f-34b1-4fd1-b327-f2c434b4d551" acquired by "delete_volume" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Deleted volume successfully. Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[97669f09-6ef3-41e8-968d-24dfff169c89]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b8ee6c27-6d73-41e1-bbac-a0ae925b15e6 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-426acd28-a1b1-4342-b048-fc826ac91a12-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:35 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 Sep 01 11:40:35 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:35 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (5f66d32f-cd9a-46a5-b20e-0ca8353ae55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0a07fb-7b21-47c3-b99e-3216b666d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-932ac18e-0464-40b1-8212-91ea1e876ee2" returned: 0 in 0.509s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0a07fb-7b21-47c3-b99e-3216b666d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543594898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c9a8d6-521e-4693-b878-4c5924470d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:36Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91da2ed-7268-4149-b53e-8c0eb9f25077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91da2ed-7268-4149-b53e-8c0eb9f25077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaecbca-485c-46df-bc9f-7d0a87ed9e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaecbca-485c-46df-bc9f-7d0a87ed9e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c9a8d6-521e-4693-b878-4c5924470d7d', 'volume_name': 'volume-08c9a8d6-521e-4693-b878-4c5924470d7d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7118a623-fcde-489d-a0a7-ff5d9ea2bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7118a623-fcde-489d-a0a7-ff5d9ea2bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258892a1-817f-4136-8153-5d395338a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume 08c9a8d6-521e-4693-b878-4c5924470d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c9a8d6-521e-4693-b878-4c5924470d7d', 'volume_size': 1} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543594898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c9a8d6-521e-4693-b878-4c5924470d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:36Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating volume 08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:35 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Lock "cinder-quobyte-932ac18e-0464-40b1-8212-91ea1e876ee2" released by "delete_volume" :: held 1.108s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:35 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d 1073741824 Sep 01 11:40:35 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Created reservations ['fcb5191f-6aee-4911-9fda-9a64bb09ba40', '6817b55a-f257-4337-b64c-d54b2988d66c', 'f4fa90d7-3e47-45c8-9e38-1fbd496a05f6', '2730d59e-88db-4521-9708-cbe8151400c2'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:35 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551" returned: 0 in 0.501s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:35 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:35 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:36 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551 Sep 01 11:40:36 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:36 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Deleted volume successfully. Sep 01 11:40:36 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a6d1d10f-34b1-4fd1-b327-f2c434b4d551" returned: 0 in 0.289s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-quobyte-a6d1d10f-34b1-4fd1-b327-f2c434b4d551" released by "delete_volume" :: held 0.860s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-fa7664fa-749f-4a77-b7b1-85fb9512f19e tempest-ProjectReaderTests-1690119986 None] Lock "cinder-932ac18e-0464-40b1-8212-91ea1e876ee2-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Created reservations ['b2906663-df4d-49ad-aa01-7fb96156175b', 'af941089-a57b-4c49-8b04-2a45ed024116', 'd346b094-b8ad-43c9-91c5-f856f5a27254', '900b2399-5bfb-4086-a2f6-7354999a627e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:36 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d 1073741824" returned: 0 in 0.538s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:36 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d Sep 01 11:40:36 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:36 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:36 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:36 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d" returned: 0 in 0.414s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258892a1-817f-4136-8153-5d395338a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c9a8d6-521e-4693-b878-4c5924470d7d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd833f64-4d03-4526-8a34-994345af53f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:36 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.427s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:36 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume volume-08c9a8d6-521e-4693-b878-4c5924470d7d (08c9a8d6-521e-4693-b878-4c5924470d7d): created successfully Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd833f64-4d03-4526-8a34-994345af53f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (5f66d32f-cd9a-46a5-b20e-0ca8353ae55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Deleted volume successfully. Sep 01 11:40:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-40585c19-4035-4bc9-b828-3f43fde6659e tempest-CreateVolumesFromSnapshotTest-418038281 None] Created volume successfully. Sep 01 11:40:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-98f46311-d65f-4d78-b32d-e7f0d9345fd7 tempest-CreateVolumesFromSourceVolumeTest-1348781399 None] Lock "cinder-a6d1d10f-34b1-4fd1-b327-f2c434b4d551-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Flow 'volume_create_manager' (83b45c4f-38c0-48a2-a892-e43c36472787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f9d1a0-04b1-413a-a917-41ba5e7afec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f9d1a0-04b1-413a-a917-41ba5e7afec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582625431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd7612e-3075-4816-a62f-0171127878a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1e5b5aabaf40478aa15c0c9f87c0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:37Z,use_quota=True,user_id='d88d64876bb049f9b86eb99b50fd2c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64623e24-0c13-4a40-9c55-6f1a58805a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64623e24-0c13-4a40-9c55-6f1a58805a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9fbe7b-c896-422a-985c-8111218a0f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9fbe7b-c896-422a-985c-8111218a0f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd7612e-3075-4816-a62f-0171127878a6', 'volume_name': 'volume-ddd7612e-3075-4816-a62f-0171127878a6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6effe829-cc1f-40e6-bd35-a63367b7a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6effe829-cc1f-40e6-bd35-a63367b7a874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90065ed-db14-42c7-9336-57286518859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Volume ddd7612e-3075-4816-a62f-0171127878a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd7612e-3075-4816-a62f-0171127878a6', 'volume_size': 1} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582625431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd7612e-3075-4816-a62f-0171127878a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1e5b5aabaf40478aa15c0c9f87c0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:37Z,use_quota=True,user_id='d88d64876bb049f9b86eb99b50fd2c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Creating volume ddd7612e-3075-4816-a62f-0171127878a6 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:37 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 1073741824 Sep 01 11:40:37 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:38 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 1073741824" returned: 0 in 0.574s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:38 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 Sep 01 11:40:38 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:38 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.400s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90065ed-db14-42c7-9336-57286518859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd7612e-3075-4816-a62f-0171127878a6', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df03f785-e09d-417d-a06c-e88d3c9e1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating offline snapshot df83b0f4-d98c-4836-ae47-6b68c886a5a1 of volume 08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:40:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Volume volume-ddd7612e-3075-4816-a62f-0171127878a6 (ddd7612e-3075-4816-a62f-0171127878a6): created successfully Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df03f785-e09d-417d-a06c-e88d3c9e1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Flow 'volume_create_manager' (83b45c4f-38c0-48a2-a892-e43c36472787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa7db8-d4e7-4754-a33e-e372a79fa8e0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4fd92372-9994-4828-8096-eb7cde4abff2 tempest-ProjectReaderTests-1690119986 None] Created volume successfully. Sep 01 11:40:38 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d Sep 01 11:40:38 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:38 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:39 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 1G Sep 01 11:40:39 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:39 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 1G" returned: 0 in 0.477s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c9a8d6-521e-4693-b878-4c5924470d7d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:39 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c9a8d6-521e-4693-b878-4c5924470d7d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 Sep 01 11:40:39 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Acquiring lock "cinder-ddd7612e-3075-4816-a62f-0171127878a6-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Lock "cinder-ddd7612e-3075-4816-a62f-0171127878a6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Acquiring lock "cinder-quobyte-ddd7612e-3075-4816-a62f-0171127878a6" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Lock "cinder-quobyte-ddd7612e-3075-4816-a62f-0171127878a6" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d80351-52d6-46e1-b647-e7cc2664893c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:39 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c9a8d6-521e-4693-b878-4c5924470d7d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:39 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 is being set with open permissions: ugo+rw Sep 01 11:40:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:39 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 Sep 01 11:40:39 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:39 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 Sep 01 11:40:39 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:40 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1" returned: 0 in 0.314s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:40 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6" returned: 0 in 0.454s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:40 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info Sep 01 11:40:40 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:40 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6 Sep 01 11:40:40 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:40 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Flow 'volume_create_manager' (351f8e27-7638-4ca4-bd7e-bb51f7357d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619fd9a1-2927-4481-a1ae-6e4e9023a9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info" returned: 0 in 0.338s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:40 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info is being set with open permissions: ugo+rw Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:40 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ddd7612e-3075-4816-a62f-0171127878a6" returned: 0 in 0.327s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:40 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info Sep 01 11:40:40 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619fd9a1-2927-4481-a1ae-6e4e9023a9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372670804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c60a0ae-24c9-47ca-9845-3d44f95ae061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a288497ff04ca58d9f2a23eec645e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:40Z,use_quota=True,user_id='a2e0ed2b84ad442480b83352dbb3fe48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91faae92-482f-4604-b484-57eaaa166d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91faae92-482f-4604-b484-57eaaa166d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0453b8c4-132b-4c1d-b764-0aa3094c1fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0453b8c4-132b-4c1d-b764-0aa3094c1fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c60a0ae-24c9-47ca-9845-3d44f95ae061', 'volume_name': 'volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c667ba78-7749-41a0-8cef-e90f0c9f08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c667ba78-7749-41a0-8cef-e90f0c9f08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272396bb-6e12-4438-837c-a4b8cbf34503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:40 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Volume 2c60a0ae-24c9-47ca-9845-3d44f95ae061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061', 'volume_size': 1} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Lock "cinder-quobyte-ddd7612e-3075-4816-a62f-0171127878a6" released by "delete_volume" :: held 0.878s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Created reservations ['28e62b98-94b5-4205-bc70-cf2b8cece847', '5cd0d501-ec33-4666-887f-d0126d411dda', 'e15206e8-ab50-4cb7-972d-cc9344ca4030', 'b0c0996e-8f0f-4810-9078-bd524d3b6cfe'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:40 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:40 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:40 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.info" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372670804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c60a0ae-24c9-47ca-9845-3d44f95ae061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a288497ff04ca58d9f2a23eec645e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:40Z,use_quota=True,user_id='a2e0ed2b84ad442480b83352dbb3fe48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Creating volume 2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:40 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:40 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 1073741824 Sep 01 11:40:40 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d847246b-aaf1-4754-a82b-3eb8ac26b5b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Create snapshot completed successfully Sep 01 11:40:41 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Deleted volume successfully. Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-943dd3b3-547f-461d-b72c-585f20d85f5f tempest-ProjectReaderTests-1690119986 None] Lock "cinder-ddd7612e-3075-4816-a62f-0171127878a6-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:41 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 1073741824" returned: 0 in 0.573s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:41 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:40:41 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:41 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272396bb-6e12-4438-837c-a4b8cbf34503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48279c31-26cf-44ac-ba43-6f5d2c1cf557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:41 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Volume volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 (2c60a0ae-24c9-47ca-9845-3d44f95ae061): created successfully Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48279c31-26cf-44ac-ba43-6f5d2c1cf557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Flow 'volume_create_manager' (351f8e27-7638-4ca4-bd7e-bb51f7357d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f03ed444-0b3f-434b-8676-972d88df4599 tempest-VolumeDependencyTests-1864576003 None] Created volume successfully. Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (f361ba41-7082-437f-bafb-04af718e6fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935a75c3-4b77-4c6e-86da-4e97d12920b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935a75c3-4b77-4c6e-86da-4e97d12920b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358405638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba574229-56b5-46d8-b0c9-e281ea3a93ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:42Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b39725-9206-473e-b5e3-a2240ac175b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b39725-9206-473e-b5e3-a2240ac175b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf76977-3136-4029-810e-d21214624388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf76977-3136-4029-810e-d21214624388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba574229-56b5-46d8-b0c9-e281ea3a93ac', 'volume_name': 'volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5243f84-bb52-428c-b679-13234201e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5243f84-bb52-428c-b679-13234201e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba862a7-a0fe-4f19-abb0-03f2ab0d886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume ba574229-56b5-46d8-b0c9-e281ea3a93ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac', 'volume_size': 1} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358405638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba574229-56b5-46d8-b0c9-e281ea3a93ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:42Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating volume ba574229-56b5-46d8-b0c9-e281ea3a93ac {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:42 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:42 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac 1073741824 Sep 01 11:40:42 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (8ce2c72f-c5b4-469c-92b9-056e86f4e8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c111bc47-a86e-4c60-88fb-26e858d05f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c111bc47-a86e-4c60-88fb-26e858d05f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021595450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cb45ad-0deb-4b83-97b9-d065ff35dc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:42Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8934a34-52b2-4b76-b2d0-bc80079a582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8934a34-52b2-4b76-b2d0-bc80079a582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1cd517-b58d-4b58-b6a8-5c40fc593475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1cd517-b58d-4b58-b6a8-5c40fc593475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75cb45ad-0deb-4b83-97b9-d065ff35dc9b', 'volume_name': 'volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089261c0-a166-42cd-804d-a28c5ec76bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089261c0-a166-42cd-804d-a28c5ec76bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e4ee83-49d4-4a92-a695-55349d407d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume 75cb45ad-0deb-4b83-97b9-d065ff35dc9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b', 'volume_size': 1} Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:42 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac 1073741824" returned: 0 in 0.774s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:43 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac Sep 01 11:40:43 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (0dcfcde7-a9b9-44e3-8f10-2b2771e6aeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4994ed11-3795-4635-882f-5d69064c806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4994ed11-3795-4635-882f-5d69064c806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443336842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d37149-1914-4ebf-b4a7-060e6e33e4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:43Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f53f0d-0b1d-4440-b527-be875d5ee600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f53f0d-0b1d-4440-b527-be875d5ee600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822a530a-d444-4476-8589-8ea7a9a88b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822a530a-d444-4476-8589-8ea7a9a88b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d37149-1914-4ebf-b4a7-060e6e33e4c7', 'volume_name': 'volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01961b1f-e03c-4d49-89b6-d7fd53632c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01961b1f-e03c-4d49-89b6-d7fd53632c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a902206-dd84-418e-9774-0598f6fd36e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume f8d37149-1914-4ebf-b4a7-060e6e33e4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7', 'volume_size': 1} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac" returned: 0 in 0.506s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021595450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cb45ad-0deb-4b83-97b9-d065ff35dc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:42Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating volume 75cb45ad-0deb-4b83-97b9-d065ff35dc9b {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:43 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba862a7-a0fe-4f19-abb0-03f2ab0d886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b 1073741824 Sep 01 11:40:43 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95df393d-5708-48f4-88a9-fc0917d59d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac (ba574229-56b5-46d8-b0c9-e281ea3a93ac): created successfully Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95df393d-5708-48f4-88a9-fc0917d59d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (f361ba41-7082-437f-bafb-04af718e6fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-af9605f3-6e4d-4041-9076-8ae8dfecbd0c tempest-CreateVolumesFromSnapshotTest-418038281 None] Created volume successfully. Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (1f8eae12-a99e-4bb4-ab7f-8df96437d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecc7e42-7834-4a43-9c33-c235a0463970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecc7e42-7834-4a43-9c33-c235a0463970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199812590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516084f2-c3c9-43a3-a280-364c4b5249b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:44Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bec2e28-0337-46e7-aeff-d9c3f5cd62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bec2e28-0337-46e7-aeff-d9c3f5cd62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f52209-eda3-4f04-9284-890baaa5d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f52209-eda3-4f04-9284-890baaa5d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516084f2-c3c9-43a3-a280-364c4b5249b2', 'volume_name': 'volume-516084f2-c3c9-43a3-a280-364c4b5249b2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b5b09c-b429-43ac-a918-3023a334f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b5b09c-b429-43ac-a918-3023a334f170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11b391e-fe3e-450e-b496-48533703e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume 516084f2-c3c9-43a3-a280-364c4b5249b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516084f2-c3c9-43a3-a280-364c4b5249b2', 'volume_size': 1} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:44 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b 1073741824" returned: 0 in 0.762s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:44 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b Sep 01 11:40:44 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:44 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b" returned: 0 in 0.347s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.420s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Creating offline snapshot 8216230b-1636-4aa4-a789-1689b64f1f1c of volume 2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e4ee83-49d4-4a92-a695-55349d407d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0efcaca-d116-493e-afa1-15c7534b230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e75c9c-6673-4511-a3dd-1106b51904b2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b (75cb45ad-0deb-4b83-97b9-d065ff35dc9b): created successfully Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0efcaca-d116-493e-afa1-15c7534b230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (8ce2c72f-c5b4-469c-92b9-056e86f4e8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8d22c7e0-d354-4d4e-91c9-25ff51479504 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created volume successfully. Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:44 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:40:44 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (6e260678-0982-478c-aaa4-c7cc64e428ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eb44b1-b630-4eea-afd0-0ee42468cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eb44b1-b630-4eea-afd0-0ee42468cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689111019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2481c6a7-f196-40b9-a92f-bcb28d5efeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:45Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f826cb8-72c9-4e23-aad2-93799db8201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f826cb8-72c9-4e23-aad2-93799db8201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a15e602-12fe-4782-a4fc-1fd67564c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a15e602-12fe-4782-a4fc-1fd67564c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2481c6a7-f196-40b9-a92f-bcb28d5efeb3', 'volume_name': 'volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcf0551-d830-483f-a1f9-fd8c7deae72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcf0551-d830-483f-a1f9-fd8c7deae72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc68a7e3-69ad-4280-a3fc-c7107d061458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume 2481c6a7-f196-40b9-a92f-bcb28d5efeb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3', 'volume_size': 1} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Flow 'volume_create_manager' (44440042-76e0-4535-9be6-5091b02cb305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f6ee9b-c46f-4a47-973c-a673b4015b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f6ee9b-c46f-4a47-973c-a673b4015b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f86b55-8c51-41d8-92a8-5eb9ababe4c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eb0c33fc44c32b60bece4dbaf90cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:45Z,use_quota=True,user_id='3105e8590531401aaa6f0f573c57bd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29489a60-8e79-4227-b02a-577c72b3f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29489a60-8e79-4227-b02a-577c72b3f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbd7c53-4354-429a-aba6-3c742cfcac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.image.glance [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Creating Keystone auth plugin from conf {{(pid=87144) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 11:40:45 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.399s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:45 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c 1G Sep 01 11:40:45 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbd7c53-4354-429a-aba6-3c742cfcac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0f86b55-8c51-41d8-92a8-5eb9ababe4c6', 'volume_name': 'volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6', 'volume_size': 1, 'image_id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/353a7662-01c0-4f7b-afde-78b04e014c20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd95b7f0064d048272f7933ab427f3e30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '643eb0c33fc44c32b60bece4dbaf90cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a17f26cafe8e39105f07e4079f255943b4a83addfa28c4e9d8e466f2ebd2e17eb6e9eb06534e4f04013540214c6bbd18e2eab509329117c75bc62a222e0c5ad7', 'id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'created_at': datetime.datetime(2026, 9, 1, 9, 40, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 40, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/353a7662-01c0-4f7b-afde-78b04e014c20/file', 'properties': {}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65197ef9-2037-407b-9eec-d80cb81a3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65197ef9-2037-407b-9eec-d80cb81a3481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f02567d-6bc2-442c-af4e-ccb07719e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:45 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Volume f0f86b55-8c51-41d8-92a8-5eb9ababe4c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6', 'volume_size': 1, 'image_id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/353a7662-01c0-4f7b-afde-78b04e014c20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd95b7f0064d048272f7933ab427f3e30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '643eb0c33fc44c32b60bece4dbaf90cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a17f26cafe8e39105f07e4079f255943b4a83addfa28c4e9d8e466f2ebd2e17eb6e9eb06534e4f04013540214c6bbd18e2eab509329117c75bc62a222e0c5ad7', 'id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'created_at': datetime.datetime(2026, 9, 1, 9, 40, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 40, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/353a7662-01c0-4f7b-afde-78b04e014c20/file', 'properties': {}}, 'image_service': } Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Trying to clone f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 from image 353a7662-01c0-4f7b-afde-78b04e014c20 at location (None, [{'url': 'file:///opt/stack/data/glance/images/353a7662-01c0-4f7b-afde-78b04e014c20', 'metadata': {}}]). {{(pid=87144) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 11:40:45 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Image download 0.00 MB at 0.00 MB/s Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d03e1-0a31-4a06-bafc-4527f2e23cf2]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:45 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD Sep 01 11:40:45 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c 1G" returned: 0 in 0.557s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:45 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:45 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c Sep 01 11:40:45 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:45 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:46 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:46 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c is being set with open permissions: ugo+rw Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:46 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD Sep 01 11:40:46 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:46 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c Sep 01 11:40:46 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:46 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c" returned: 0 in 0.297s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:46 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Temporary image 353a7662-01c0-4f7b-afde-78b04e014c20 is fetched for user 3105e8590531401aaa6f0f573c57bd1c. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:46 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info Sep 01 11:40:46 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e69d9-d067-4f42-aa5e-ad9ce0defd3b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:46 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD Sep 01 11:40:46 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:46 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:46 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info is being set with open permissions: ugo+rw Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:46 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info Sep 01 11:40:46 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:46 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:47 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.info" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:47 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD Sep 01 11:40:47 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.510s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443336842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d37149-1914-4ebf-b4a7-060e6e33e4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:43Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating volume f8d37149-1914-4ebf-b4a7-060e6e33e4c7 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:47 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:47 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 1073741824 Sep 01 11:40:47 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0efb8495-a690-49d1-9aeb-65090cefd441 tempest-VolumeDependencyTests-1864576003 None] Create snapshot completed successfully Sep 01 11:40:47 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:47 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 1073741824" returned: 0 in 0.431s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:47 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 Sep 01 11:40:47 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:47 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7" returned: 0 in 0.277s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.801s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199812590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516084f2-c3c9-43a3-a280-364c4b5249b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:44Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating volume 516084f2-c3c9-43a3-a280-364c4b5249b2 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:47 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a902206-dd84-418e-9774-0598f6fd36e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:47 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 1073741824 Sep 01 11:40:47 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955de036-87d4-427b-85e4-d0f987150639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:47 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 (f8d37149-1914-4ebf-b4a7-060e6e33e4c7): created successfully Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955de036-87d4-427b-85e4-d0f987150639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:47 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (0dcfcde7-a9b9-44e3-8f10-2b2771e6aeb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c80a6536-09e7-4a9f-8e28-f836ed6e8180 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created volume successfully. Sep 01 11:40:48 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 1073741824" returned: 0 in 0.498s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:48 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 Sep 01 11:40:48 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Flow 'volume_create_manager' (458a4ddb-340b-4f59-af92-821cad4a99ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d897ffce-a601-47b1-83e8-5325108f37ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:48 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d897ffce-a601-47b1-83e8-5325108f37ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-152139347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a288497ff04ca58d9f2a23eec645e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8216230b-1636-4aa4-a789-1689b64f1f1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:49Z,use_quota=True,user_id='a2e0ed2b84ad442480b83352dbb3fe48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b9764-6927-47bb-9207-547bf2b06675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b9764-6927-47bb-9207-547bf2b06675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594ac88b-4b72-4df0-b497-148df76794cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594ac88b-4b72-4df0-b497-148df76794cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce', 'volume_name': 'volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce', 'volume_size': 1, 'snapshot_id': '8216230b-1636-4aa4-a789-1689b64f1f1c'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5468c1ab-b588-4561-826b-b62ddbcb8562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5468c1ab-b588-4561-826b-b62ddbcb8562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef641c1d-7ae7-47d0-8562-5a35867365ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Volume 1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce', 'volume_size': 1, 'snapshot_id': '8216230b-1636-4aa4-a789-1689b64f1f1c'} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2" returned: 0 in 0.353s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689111019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2481c6a7-f196-40b9-a92f-bcb28d5efeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dda677b8e32414bacbfcb6a436f854f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:45Z,use_quota=True,user_id='8e055506e7594744be2c25a465666fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Creating volume 2481c6a7-f196-40b9-a92f-bcb28d5efeb3 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:48 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:48 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 1073741824 Sep 01 11:40:48 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11b391e-fe3e-450e-b496-48533703e71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516084f2-c3c9-43a3-a280-364c4b5249b2', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a110b599-74b3-406c-9e30-c4ecb2d96595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume volume-516084f2-c3c9-43a3-a280-364c4b5249b2 (516084f2-c3c9-43a3-a280-364c4b5249b2): created successfully Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a110b599-74b3-406c-9e30-c4ecb2d96595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (1f8eae12-a99e-4bb4-ab7f-8df96437d36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-46738b4f-c145-4879-9eca-df8850fa4db3 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created volume successfully. Sep 01 11:40:49 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 1073741824" returned: 0 in 0.474s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:49 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 Sep 01 11:40:49 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:49 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3" returned: 0 in 0.252s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f86b55-8c51-41d8-92a8-5eb9ababe4c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eb0c33fc44c32b60bece4dbaf90cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:40:45Z,use_quota=True,user_id='3105e8590531401aaa6f0f573c57bd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Creating volume f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:49 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc68a7e3-69ad-4280-a3fc-c7107d061458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602b710e-59e3-4a3d-8622-4d39ba899d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:49 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 1073741824 Sep 01 11:40:49 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:49 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Volume volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 (2481c6a7-f196-40b9-a92f-bcb28d5efeb3): created successfully Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602b710e-59e3-4a3d-8622-4d39ba899d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Flow 'volume_create_manager' (6e260678-0982-478c-aaa4-c7cc64e428ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:49 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a75a921d-e4bc-4483-a3f1-1c73f5d57c84 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created volume successfully. Sep 01 11:40:49 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 1073741824" returned: 0 in 0.456s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:50 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:50 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:50 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 0 in 0.266s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.515s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-quobyte-8216230b-1636-4aa4-a789-1689b64f1f1c-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-8216230b-1636-4aa4-a789-1689b64f1f1c-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Creating volume 1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce from snapshot 8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-quobyte-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Attempting download of 353a7662-01c0-4f7b-afde-78b04e014c20 ((None, [{'url': 'file:///opt/stack/data/glance/images/353a7662-01c0-4f7b-afde-78b04e014c20', 'metadata': {}}])) to volume f0f86b55-8c51-41d8-92a8-5eb9ababe4c6. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] snapshot: 8216230b-1636-4aa4-a789-1689b64f1f1c, volume: 1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-2481c6a7-f196-40b9-a92f-bcb28d5efeb3-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c935b-8f03-4042-a7a1-f84f7f5c6332]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f7d52-f6e3-4efa-96ca-9b0bcdd31421]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-2481c6a7-f196-40b9-a92f-bcb28d5efeb3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-2481c6a7-f196-40b9-a92f-bcb28d5efeb3" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-2481c6a7-f196-40b9-a92f-bcb28d5efeb3" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:50 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c Sep 01 11:40:50 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68acc1-2dae-4f4a-b195-792b015de286]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:50 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i Sep 01 11:40:50 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:50 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 Sep 01 11:40:50 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:50 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c" returned: 0 in 0.438s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f795d-cd3e-49c3-9e1b-d3194b94b754]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:50 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i" returned: 0 in 0.465s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:51 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:40:51 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3" returned: 0 in 0.454s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:51 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i Sep 01 11:40:51 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3 Sep 01 11:40:51 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i" returned: 1 in 0.379s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353a7662-01c0-4f7b-afde-78b04e014c20_i9utgh3i' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba57f8-7ff3-449f-9bd8-d6bb664ec24f]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:51 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.514s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:51 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2481c6a7-f196-40b9-a92f-bcb28d5efeb3" returned: 0 in 0.356s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:51 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce Sep 01 11:40:51 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-2481c6a7-f196-40b9-a92f-bcb28d5efeb3" released by "delete_volume" :: held 0.884s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:51 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['1a6fffea-be64-496b-af65-6227aebd9cd3', '30d7b4c8-c1c0-48fd-8364-654cafe3da86', '160a71b6-9a27-40a3-b747-f1de833c42e7', '5da70fb9-ae86-4c5f-9b6a-e233671c1157'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:51 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:51 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:51 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD Sep 01 11:40:51 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:51 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.282s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:51 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleted volume successfully. Sep 01 11:40:51 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b291329b-c872-4f3e-87de-3d57b3b6ecce tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-2481c6a7-f196-40b9-a92f-bcb28d5efeb3-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:52 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD" returned: 1 in 0.951s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:52 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] 353a7662-01c0-4f7b-afde-78b04e014c20 was raw, converting to raw {{(pid=87144) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 11:40:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:52 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:52 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-516084f2-c3c9-43a3-a280-364c4b5249b2-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-516084f2-c3c9-43a3-a280-364c4b5249b2-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-516084f2-c3c9-43a3-a280-364c4b5249b2" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-516084f2-c3c9-43a3-a280-364c4b5249b2" acquired by "delete_volume" :: waited 0.048s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c9fb4-b141-4dd9-b36c-674c74e913f6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:53 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 0 in 0.850s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_353a7662-01c0-4f7b-afde-78b04e014c20_mx38xioadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:40:53 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 11:40:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:53 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 Sep 01 11:40:53 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:53 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 1G Sep 01 11:40:53 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:54 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 1G" returned: 0 in 0.949s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:54 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2" returned: 0 in 1.272s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:54 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[afedd6d6-7a06-466f-b33d-ece4c6e667d0]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:54 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2 Sep 01 11:40:54 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:54 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:54 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:55 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-516084f2-c3c9-43a3-a280-364c4b5249b2" returned: 0 in 0.890s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-516084f2-c3c9-43a3-a280-364c4b5249b2" released by "delete_volume" :: held 2.279s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:55 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 0 in 1.016s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['14ae2b5f-b970-4aaa-9107-d17ded7c9e56', '704c81d2-7188-428a-8474-1e2fc2619062', '8c317327-b66e-46e6-ac0f-928bbe37bb2f', 'ede1afe5-b22d-4f66-ae4f-78d166f93fc5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:55 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:55 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:56 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:56 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:56 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 1 in 0.871s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Downloaded image 353a7662-01c0-4f7b-afde-78b04e014c20 ((None, [{'url': 'file:///opt/stack/data/glance/images/353a7662-01c0-4f7b-afde-78b04e014c20', 'metadata': {}}])) to volume f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 successfully. {{(pid=87144) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Temporary image 353a7662-01c0-4f7b-afde-78b04e014c20 for user 3105e8590531401aaa6f0f573c57bd1c is deleted. {{(pid=87144) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.volume_utils [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Marking volume f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 as bootable. {{(pid=87144) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Copying metadata from image 353a7662-01c0-4f7b-afde-78b04e014c20 to f0f86b55-8c51-41d8-92a8-5eb9ababe4c6. {{(pid=87144) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Creating volume glance metadata for volume f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 backed by image 353a7662-01c0-4f7b-afde-78b04e014c20 with: {'image_id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd95b7f0064d048272f7933ab427f3e30', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87144) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 11:40:56 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.752s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleted volume successfully. Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e123dee8-bb2c-4f55-8574-a94bbf84cd2d tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-516084f2-c3c9-43a3-a280-364c4b5249b2-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-f8d37149-1914-4ebf-b4a7-060e6e33e4c7-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f02567d-6bc2-442c-af4e-ccb07719e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6', 'volume_size': 1, 'image_id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/353a7662-01c0-4f7b-afde-78b04e014c20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd95b7f0064d048272f7933ab427f3e30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '643eb0c33fc44c32b60bece4dbaf90cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a17f26cafe8e39105f07e4079f255943b4a83addfa28c4e9d8e466f2ebd2e17eb6e9eb06534e4f04013540214c6bbd18e2eab509329117c75bc62a222e0c5ad7', 'id': '353a7662-01c0-4f7b-afde-78b04e014c20', 'created_at': datetime.datetime(2026, 9, 1, 9, 40, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 40, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/353a7662-01c0-4f7b-afde-78b04e014c20/file', 'properties': {}}, 'image_service': }' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6f3b0e-d7b2-4720-9853-b89fd07290ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:56 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Volume volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 (f0f86b55-8c51-41d8-92a8-5eb9ababe4c6): created successfully Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6f3b0e-d7b2-4720-9853-b89fd07290ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Flow 'volume_create_manager' (44440042-76e0-4535-9be6-5091b02cb305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-f8d37149-1914-4ebf-b4a7-060e6e33e4c7-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-19d2faa6-8bbc-432f-8471-77c169075b0b tempest-VolumeImageDependencyTests-1071510878 None] Created volume successfully. Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-f8d37149-1914-4ebf-b4a7-060e6e33e4c7" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-f8d37149-1914-4ebf-b4a7-060e6e33e4c7" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d7b05b-576a-42d8-a2b6-b473de83345b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:57 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 Sep 01 11:40:57 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Acquiring lock "cinder-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:57 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" returned: 0 in 6.142s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Lock "cinder-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a004180-833f-4589-b790-4059a3842448]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Acquiring lock "cinder-quobyte-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Lock "cinder-quobyte-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656273c-f425-4488-ace7-85bd8cfb3e13]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:57 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:40:57 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:57 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7" returned: 0 in 0.710s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:57 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:57 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:57 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7 Sep 01 11:40:57 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:58 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f8d37149-1914-4ebf-b4a7-060e6e33e4c7" returned: 0 in 0.309s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 0 in 0.448s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:58 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-f8d37149-1914-4ebf-b4a7-060e6e33e4c7" released by "delete_volume" :: held 1.129s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.616s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:40:58 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Converted 1024.00 MB image at 166.56 MB/s Sep 01 11:40:58 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce is being set with open permissions: ugo+rw Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:58 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce Sep 01 11:40:58 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['74ba5f81-a727-4c55-95ac-1586ff72a3d2', '53ddcf61-a1c5-4d32-9829-bf523ddc8784', '67365e28-ef6c-4517-b5d9-3668e22bd660', 'ff028dc0-8c73-4295-a41b-972b4360abb4'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:58 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:58 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:58 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:58 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:58 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" returned: 0 in 0.340s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" released by "_copy_volume_from_snapshot" :: held 8.198s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 1 in 0.377s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6' failed. Not Retrying. {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-8216230b-1636-4aa4-a789-1689b64f1f1c-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" released by "_create_volume_from_snapshot" :: held 8.260s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.290s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:58 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6 Sep 01 11:40:58 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef641c1d-7ae7-47d0-8562-5a35867365ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce', 'volume_size': 1, 'snapshot_id': '8216230b-1636-4aa4-a789-1689b64f1f1c'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6a6195-480f-4e2b-a4a0-4c740b67ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:40:58 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Volume volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce (1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce): created successfully Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6a6195-480f-4e2b-a4a0-4c740b67ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:40:58 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Flow 'volume_create_manager' (458a4ddb-340b-4f59-af92-821cad4a99ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.339s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleted volume successfully. Sep 01 11:40:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0d7f6ee0-689c-4b66-a012-85b0f90f4b76 tempest-VolumeDependencyTests-1864576003 None] Created volume successfully. Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-044c72e0-cf3f-41e7-bc2f-9a9077c0b778 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-f8d37149-1914-4ebf-b4a7-060e6e33e4c7-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:58 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" returned: 0 in 0.344s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Lock "cinder-quobyte-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6" released by "delete_volume" :: held 1.243s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Created reservations ['c9d38c51-86a4-42ed-a403-73427d65f789', 'e2fdae28-98cb-422c-bb2f-87dfe3a7eede', '1bdb2a16-b736-4f28-ad76-d9913e231f48', 'dbf48060-2bb1-4e45-9d2e-44603a40ed80'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:40:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:59 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:40:59 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-75cb45ad-0deb-4b83-97b9-d065ff35dc9b-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:59 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.273s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-75cb45ad-0deb-4b83-97b9-d065ff35dc9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Deleted volume successfully. Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-17fd4f34-f64f-4d55-bb01-e369592dec5a tempest-VolumeImageDependencyTests-1071510878 None] Lock "cinder-f0f86b55-8c51-41d8-92a8-5eb9ababe4c6-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-75cb45ad-0deb-4b83-97b9-d065ff35dc9b" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-75cb45ad-0deb-4b83-97b9-d065ff35dc9b" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c04ea73-7a0a-453a-82b7-54c06b3be707]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:59 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b Sep 01 11:40:59 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-8216230b-1636-4aa4-a789-1689b64f1f1c-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:59 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b" returned: 0 in 0.451s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:40:59 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b Sep 01 11:40:59 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-8216230b-1636-4aa4-a789-1689b64f1f1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-quobyte-2c60a0ae-24c9-47ca-9845-3d44f95ae061" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-2c60a0ae-24c9-47ca-9845-3d44f95ae061" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-quobyte-8216230b-1636-4aa4-a789-1689b64f1f1c" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-8216230b-1636-4aa4-a789-1689b64f1f1c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Deleting offline snapshot 8216230b-1636-4aa4-a789-1689b64f1f1c of volume 2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] snapshot_file for this snap is: volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ddc8a-a973-49d4-90f2-ff2b8ee7132d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:40:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (53c84ea2-5925-4a49-ae26-35c50cf3cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0547f3de-3b1b-4e09-a78d-4185d204241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0547f3de-3b1b-4e09-a78d-4185d204241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267761580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f2ca67-25c8-4cde-bee7-e0a67efa74ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:00Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41722e9e-8c4f-496d-b301-c921d37471f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41722e9e-8c4f-496d-b301-c921d37471f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851388f9-285e-4088-a755-6a331b0247fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851388f9-285e-4088-a755-6a331b0247fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f2ca67-25c8-4cde-bee7-e0a67efa74ca', 'volume_name': 'volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a7682b-70db-4268-a1df-1495e374757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a7682b-70db-4268-a1df-1495e374757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26d3cce-ab1a-42c2-8e70-98e881e31c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:00 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Volume 96f2ca67-25c8-4cde-bee7-e0a67efa74ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca', 'volume_size': 1} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:00 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:00 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267761580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f2ca67-25c8-4cde-bee7-e0a67efa74ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:00Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Creating volume 96f2ca67-25c8-4cde-bee7-e0a67efa74ca {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:00 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:00 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-75cb45ad-0deb-4b83-97b9-d065ff35dc9b" returned: 0 in 0.300s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:00 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca 1073741824 Sep 01 11:41:00 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-75cb45ad-0deb-4b83-97b9-d065ff35dc9b" released by "delete_volume" :: held 0.796s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['d16b185c-2179-444b-ab45-e61106ea75f9', 'bef610db-9f9e-483f-b3eb-fc07b13fdbf9', '0e9eb557-1a42-4784-a81c-c6922c53cfca', '6899e020-8f94-47e8-b312-d7075dc18a52'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:00 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:00 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:00 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c" returned: 0 in 0.491s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-ba574229-56b5-46d8-b0c9-e281ea3a93ac-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07e073-226c-46b1-9621-c7c8ff4e5154]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-ba574229-56b5-46d8-b0c9-e281ea3a93ac-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-ba574229-56b5-46d8-b0c9-e281ea3a93ac" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:00 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-ba574229-56b5-46d8-b0c9-e281ea3a93ac" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:00 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleted volume successfully. Sep 01 11:41:00 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca 1073741824" returned: 0 in 0.558s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:00 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:41:00 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[20093edd-bde8-46a4-b36a-d36d9a8d75fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8989d52b-c099-48a6-86dc-02511c89edcd tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-75cb45ad-0deb-4b83-97b9-d065ff35dc9b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:00 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca Sep 01 11:41:00 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:00 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac Sep 01 11:41:00 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:01 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.516s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:01 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c Sep 01 11:41:01 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:01 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca" returned: 0 in 0.375s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:01 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26d3cce-ab1a-42c2-8e70-98e881e31c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e343b063-1806-4ea3-a34a-a0c568774ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac" returned: 0 in 0.475s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:01 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Volume volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca (96f2ca67-25c8-4cde-bee7-e0a67efa74ca): created successfully Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e343b063-1806-4ea3-a34a-a0c568774ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:01 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac Sep 01 11:41:01 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (53c84ea2-5925-4a49-ae26-35c50cf3cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c2fefd32-886e-4368-835a-aae5677c1a48 tempest-ProjectReaderTests-770613076 None] Created volume successfully. Sep 01 11:41:01 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c" returned: 0 in 0.393s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:01 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-ba574229-56b5-46d8-b0c9-e281ea3a93ac" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:01 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c Sep 01 11:41:01 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-ba574229-56b5-46d8-b0c9-e281ea3a93ac" released by "delete_volume" :: held 0.810s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['960be3a1-dfd2-48cc-911b-d8f2f466897a', '3a6e7689-0d86-423d-a971-2d1d11b27424', '9983b25c-925a-4453-96c6-803276d15dde', '2f108926-fdc9-4faa-bf2c-380cd6064421'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-df83b0f4-d98c-4836-ae47-6b68c886a5a1-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:01 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:01 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:01 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061.8216230b-1636-4aa4-a789-1689b64f1f1c" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-df83b0f4-d98c-4836-ae47-6b68c886a5a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-08c9a8d6-521e-4693-b878-4c5924470d7d" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-8216230b-1636-4aa4-a789-1689b64f1f1c" released by "_delete_snapshot" :: held 1.931s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-08c9a8d6-521e-4693-b878-4c5924470d7d" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-df83b0f4-d98c-4836-ae47-6b68c886a5a1" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-2c60a0ae-24c9-47ca-9845-3d44f95ae061" released by "delete_snapshot" :: held 1.969s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-df83b0f4-d98c-4836-ae47-6b68c886a5a1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleting offline snapshot df83b0f4-d98c-4836-ae47-6b68c886a5a1 of volume 08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] snapshot_file for this snap is: volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b776678-2d4d-4a46-aa78-ce8e67fc9524]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:01 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Created reservations ['e75ff175-8fc3-4adb-80d2-e017c81c2484', '3487417a-891e-40fa-9a8d-2025d486529f', '48bac847-6b6e-48f2-9510-abc5876a0cd8', 'bbd949fc-1bd6-4ca9-98d1-93eaa26486db'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:02 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.381s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleted volume successfully. Sep 01 11:41:02 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 Sep 01 11:41:02 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-238bd023-3647-4cab-aa15-976451bc53ad tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-ba574229-56b5-46d8-b0c9-e281ea3a93ac-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Delete snapshot completed successfully. Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5debfbc4-0e0f-4526-b42b-70d7746cc064 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-8216230b-1636-4aa4-a789-1689b64f1f1c-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-96f2ca67-25c8-4cde-bee7-e0a67efa74ca-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Lock "cinder-96f2ca67-25c8-4cde-bee7-e0a67efa74ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-quobyte-96f2ca67-25c8-4cde-bee7-e0a67efa74ca" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:02 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1" returned: 0 in 0.504s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08c9a8d6-521e-4693-b878-4c5924470d7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-96f2ca67-25c8-4cde-bee7-e0a67efa74ca" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2abb0-1eb1-4cb7-b578-f17b5780d3f3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299691b-e4e5-4dfb-bcdd-01a1609aac38]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:02 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d Sep 01 11:41:02 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:02 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca Sep 01 11:41:02 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:02 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:02 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d" returned: 0 in 0.426s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:02 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca Sep 01 11:41:02 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:02 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 Sep 01 11:41:02 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-2c60a0ae-24c9-47ca-9845-3d44f95ae061-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-2c60a0ae-24c9-47ca-9845-3d44f95ae061-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:03 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-96f2ca67-25c8-4cde-bee7-e0a67efa74ca" returned: 0 in 0.311s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-quobyte-2c60a0ae-24c9-47ca-9845-3d44f95ae061" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-96f2ca67-25c8-4cde-bee7-e0a67efa74ca" released by "delete_volume" :: held 0.751s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-2c60a0ae-24c9-47ca-9845-3d44f95ae061" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6723c-bc80-456d-add5-d83cdf049541]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Created reservations ['72616d58-442e-4b0b-8d8c-5fc34c612a44', '9cbd152f-9868-4a4b-8444-126d63a8689c', '9781ace2-3884-4c98-ad15-dbe04705f562', 'a869fba7-6ac8-4e7f-8005-1b87e52c00d5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:03 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1" returned: 0 in 0.467s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:03 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1 Sep 01 11:41:03 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:03 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:41:03 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:03 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:03 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:03 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Flow 'volume_create_manager' (b6711dd3-3b98-4c6d-a2b4-f01a8b497095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:03 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32da783-1ebb-4f18-b4cc-83c807cf3026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:03 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.378s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.566s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d.df83b0f4-d98c-4836-ae47-6b68c886a5a1" returned: 0 in 0.475s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32da783-1ebb-4f18-b4cc-83c807cf3026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9da23be-638a-464e-88c4-ca49e6bf193a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54a72fe1340443387a801741127c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:04Z,use_quota=True,user_id='0656f6f50f75454a94290dcc2550cba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003f6a23-3272-4241-89d1-e8fd01afe60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003f6a23-3272-4241-89d1-e8fd01afe60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d74be0-6356-4c25-a303-14ccb56125b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d74be0-6356-4c25-a303-14ccb56125b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9da23be-638a-464e-88c4-ca49e6bf193a', 'volume_name': 'volume-a9da23be-638a-464e-88c4-ca49e6bf193a', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3740bd-115f-4ad5-8664-38eaa11eb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3740bd-115f-4ad5-8664-38eaa11eb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5f942-1e04-460e-8dbc-f9ca38d3258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:03 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Volume a9da23be-638a-464e-88c4-ca49e6bf193a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9da23be-638a-464e-88c4-ca49e6bf193a', 'volume_size': 1} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9da23be-638a-464e-88c4-ca49e6bf193a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54a72fe1340443387a801741127c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:04Z,use_quota=True,user_id='0656f6f50f75454a94290dcc2550cba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Creating volume a9da23be-638a-464e-88c4-ca49e6bf193a {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:03 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:03 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a 1073741824 Sep 01 11:41:03 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:03 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Deleted volume successfully. Sep 01 11:41:03 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061 Sep 01 11:41:03 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-df83b0f4-d98c-4836-ae47-6b68c886a5a1" released by "_delete_snapshot" :: held 2.099s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-08c9a8d6-521e-4693-b878-4c5924470d7d" released by "delete_snapshot" :: held 2.151s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ca0e1dc3-6a14-4433-9d40-98e023cd04f3 tempest-ProjectReaderTests-770613076 None] Lock "cinder-96f2ca67-25c8-4cde-bee7-e0a67efa74ca-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['01c95c35-534b-44bb-b284-c69508bd35dd', '61a13fcf-6155-4ad3-9956-05bf81454b8a', '7931b543-881b-443f-9316-735508a0ec8c', '7eeec7f2-3fc7-4a8b-a370-305109167d81'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Delete snapshot completed successfully. Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d7ebb6ea-952f-41c2-b144-75da2c303381 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-df83b0f4-d98c-4836-ae47-6b68c886a5a1-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:04 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-2c60a0ae-24c9-47ca-9845-3d44f95ae061" returned: 0 in 0.387s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-2c60a0ae-24c9-47ca-9845-3d44f95ae061" released by "delete_volume" :: held 1.091s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (c40a0ac6-2856-4144-887d-70ea99a5912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da4d9c9-c9ae-4e2f-a4f1-939f2e6e567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da4d9c9-c9ae-4e2f-a4f1-939f2e6e567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441066677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfbdb39-c447-48c3-8804-7cec9cdb7b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:04Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2087cf5d-91ad-4b76-8bab-8fdc2c05e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2087cf5d-91ad-4b76-8bab-8fdc2c05e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccab4860-4534-4523-824d-75d4f820d5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccab4860-4534-4523-824d-75d4f820d5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfbdb39-c447-48c3-8804-7cec9cdb7b67', 'volume_name': 'volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f8231f-5df6-4702-8b56-17161fcc7d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f8231f-5df6-4702-8b56-17161fcc7d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bdc2c8-5786-49bc-8b6b-ef0bcd4a3083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:04 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Volume 7bfbdb39-c447-48c3-8804-7cec9cdb7b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67', 'volume_size': 1} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:04 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a 1073741824" returned: 0 in 0.532s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Created reservations ['68a1e751-2e77-45e7-9ba4-29ddd20f3531', 'b4e6ade6-9f7f-43d2-8017-014594183369', '947d4216-aba4-42da-bdca-adf14c7cc663', '40b56f56-08a8-4ef8-b7fa-30eb5d941d5e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:04 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a Sep 01 11:41:04 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:04 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:04 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:04 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:04 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:04 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a" returned: 0 in 0.254s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441066677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfbdb39-c447-48c3-8804-7cec9cdb7b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:04Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Creating volume 7bfbdb39-c447-48c3-8804-7cec9cdb7b67 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:04 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5f942-1e04-460e-8dbc-f9ca38d3258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9da23be-638a-464e-88c4-ca49e6bf193a', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:04 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 1073741824 Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c647f9ca-5bac-4714-b328-46ae08b7d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:04 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:04 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Volume volume-a9da23be-638a-464e-88c4-ca49e6bf193a (a9da23be-638a-464e-88c4-ca49e6bf193a): created successfully Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c647f9ca-5bac-4714-b328-46ae08b7d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:04 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Flow 'volume_create_manager' (b6711dd3-3b98-4c6d-a2b4-f01a8b497095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Deleted volume successfully. Sep 01 11:41:04 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-43d0e162-480f-4111-81f7-fd9f27c21f06 tempest-CinderUnicodeTest-1805294582 None] Created volume successfully. Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1ce25d89-1b5e-40a3-b5b0-58a1ea0b6936 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-2c60a0ae-24c9-47ca-9845-3d44f95ae061-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:04 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.289s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-08c9a8d6-521e-4693-b878-4c5924470d7d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-08c9a8d6-521e-4693-b878-4c5924470d7d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "cinder-quobyte-08c9a8d6-521e-4693-b878-4c5924470d7d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-08c9a8d6-521e-4693-b878-4c5924470d7d" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[823523b6-62cd-4e2a-a6d2-d52f09951bfd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:05 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d Sep 01 11:41:05 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:05 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 1073741824" returned: 0 in 0.463s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:05 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 Sep 01 11:41:05 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "cinder-quobyte-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" acquired by "delete_volume" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:05 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d" returned: 0 in 0.415s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd30ef-42d0-49dd-ac88-55abd75f355f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:05 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d Sep 01 11:41:05 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:05 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bdc2c8-5786-49bc-8b6b-ef0bcd4a3083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f36c19a-f86c-4e9a-b09f-1e47c4259006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:05 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Volume volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 (7bfbdb39-c447-48c3-8804-7cec9cdb7b67): created successfully Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f36c19a-f86c-4e9a-b09f-1e47c4259006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (c40a0ac6-2856-4144-887d-70ea99a5912b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-9184d92b-459c-4b48-b6c6-1ccf3ad973c7 tempest-ProjectReaderTests-770613076 None] Created volume successfully. Sep 01 11:41:05 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce Sep 01 11:41:05 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:05 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-08c9a8d6-521e-4693-b878-4c5924470d7d" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-quobyte-08c9a8d6-521e-4693-b878-4c5924470d7d" released by "delete_volume" :: held 0.738s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Created reservations ['fac86309-3f90-4efb-8826-8fdb85812512', '487b1bb9-1040-4324-aa83-b2a512323a43', '9c38b913-e6a3-4bdc-a5ea-ce2a299e9809', '24541f4d-31f1-4d65-9f5f-1f53902ba872'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:05 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" returned: 0 in 0.420s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:05 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:05 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:05 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce Sep 01 11:41:05 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:06 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.293s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Deleted volume successfully. Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-499af1fa-eb36-4645-a0eb-36dc880bb9b0 tempest-CreateVolumesFromSnapshotTest-418038281 None] Lock "cinder-08c9a8d6-521e-4693-b878-4c5924470d7d-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:06 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-quobyte-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce" released by "delete_volume" :: held 0.858s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-7bfbdb39-c447-48c3-8804-7cec9cdb7b67-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Flow 'volume_create_manager' (4081c0d0-1b17-4402-9735-98b89a71be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a486c41-9d26-4692-885c-44e92b5cc0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=283,cinder:SELECT=207,cinder:INSERT=70,cinder:DELETE=24 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Lock "cinder-7bfbdb39-c447-48c3-8804-7cec9cdb7b67-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a486c41-9d26-4692-885c-44e92b5cc0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-351787348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a226bd-9061-404c-92c4-f8643f0a1b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54a72fe1340443387a801741127c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:06Z,use_quota=True,user_id='0656f6f50f75454a94290dcc2550cba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af42a2b-5770-4d93-b31e-d2b0a904c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af42a2b-5770-4d93-b31e-d2b0a904c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d84a7d-9c40-4728-b01e-46cfcb5e00cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d84a7d-9c40-4728-b01e-46cfcb5e00cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a226bd-9061-404c-92c4-f8643f0a1b48', 'volume_name': 'volume-64a226bd-9061-404c-92c4-f8643f0a1b48', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26d447c-6edc-4592-a7a8-508372135a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26d447c-6edc-4592-a7a8-508372135a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3569c6-1c63-4007-a60f-0cd4e03ccc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:06 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Volume 64a226bd-9061-404c-92c4-f8643f0a1b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a226bd-9061-404c-92c4-f8643f0a1b48', 'volume_size': 1} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-351787348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a226bd-9061-404c-92c4-f8643f0a1b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54a72fe1340443387a801741127c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:06Z,use_quota=True,user_id='0656f6f50f75454a94290dcc2550cba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Creating volume 64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:06 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Created reservations ['ff3e7cda-7295-465a-9f1d-795186d5eba5', '03abda23-3ba9-4057-92c8-8f587032ab6e', 'aefaafde-d4d3-4900-ad04-b7e03a7c2c88', '432bb87d-5e5e-4858-a7e0-cb3f7d06883f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:06 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 1073741824 Sep 01 11:41:06 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-quobyte-7bfbdb39-c447-48c3-8804-7cec9cdb7b67" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-7bfbdb39-c447-48c3-8804-7cec9cdb7b67" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=200,cinder:UPDATE=282,cinder:DELETE=27,cinder:INSERT=80 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2dd39b-289e-4b17-b03e-01601fe97404]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:06 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:06 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:06 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 Sep 01 11:41:06 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:06 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.313s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Deleted volume successfully. Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-71a3321e-60e9-4bbb-9342-06390dc042f7 tempest-VolumeDependencyTests-1864576003 None] Lock "cinder-1f4f4d2e-0b2d-4aee-92a6-d9d111a56cce-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:07 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 1073741824" returned: 0 in 0.548s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:07 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67" returned: 0 in 0.435s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:07 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67 Sep 01 11:41:07 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:07 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 Sep 01 11:41:07 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:07 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7bfbdb39-c447-48c3-8804-7cec9cdb7b67" returned: 0 in 0.265s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-7bfbdb39-c447-48c3-8804-7cec9cdb7b67" released by "delete_volume" :: held 0.760s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:07 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48" returned: 0 in 0.285s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3569c6-1c63-4007-a60f-0cd4e03ccc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a226bd-9061-404c-92c4-f8643f0a1b48', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5a8819-9dbb-4b5c-8a46-545339b8e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Created reservations ['99492c5c-b047-4e92-9193-c28c31f6911c', 'f126c83e-3112-4234-92d7-1a25958ade9a', '7969c584-cc06-4066-8c39-507273e229a8', '9e444b06-dcd1-41c9-b2e6-279ed0fddfb1'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:07 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Volume volume-64a226bd-9061-404c-92c4-f8643f0a1b48 (64a226bd-9061-404c-92c4-f8643f0a1b48): created successfully Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5a8819-9dbb-4b5c-8a46-545339b8e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Flow 'volume_create_manager' (4081c0d0-1b17-4402-9735-98b89a71be98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-00955a2a-1a6f-4499-81e3-a0222246c309 tempest-CinderUnicodeTest-1805294582 None] Created volume successfully. Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:07 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:07 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:07 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.279s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Deleted volume successfully. Sep 01 11:41:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-74bbc58e-1be1-4007-a3be-7aa0b5366f74 tempest-ProjectReaderTests-770613076 None] Lock "cinder-7bfbdb39-c447-48c3-8804-7cec9cdb7b67-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Creating offline snapshot e9620082-57a9-4169-b9a0-e082e9a12dbd of volume 64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf501b0-f436-4a3e-ace5-bb15ea8d987c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:08 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 Sep 01 11:41:08 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (6ad8d5fa-c35b-4d66-9a75-6fee245031ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d03f36-c56d-40e7-b3b7-70df7b80209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:09 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48" returned: 0 in 0.562s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d03f36-c56d-40e7-b3b7-70df7b80209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1241291611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdf434c-87d9-4b6a-8d16-9c63537c7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:09Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31590ed-b9b1-4da6-a656-b027d32f7920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:09 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd 1G Sep 01 11:41:09 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31590ed-b9b1-4da6-a656-b027d32f7920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63ee02b-0e0a-49b0-abf8-8aabb09ee7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63ee02b-0e0a-49b0-abf8-8aabb09ee7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fdf434c-87d9-4b6a-8d16-9c63537c7187', 'volume_name': 'volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b503840d-f529-487f-8575-16538110115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b503840d-f529-487f-8575-16538110115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5375a527-bc49-4076-a81a-be3c3fe159b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:09 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Volume 7fdf434c-87d9-4b6a-8d16-9c63537c7187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187', 'volume_size': 1} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:09 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd 1G" returned: 0 in 0.514s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a226bd-9061-404c-92c4-f8643f0a1b48 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:09 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a226bd-9061-404c-92c4-f8643f0a1b48 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd Sep 01 11:41:09 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:10 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a226bd-9061-404c-92c4-f8643f0a1b48 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:10 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd is being set with open permissions: ugo+rw Sep 01 11:41:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:10 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd Sep 01 11:41:10 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:10 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd" returned: 0 in 0.274s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:10 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info Sep 01 11:41:10 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:10 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:10 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info is being set with open permissions: ugo+rw Sep 01 11:41:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:10 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info Sep 01 11:41:10 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:11 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.info" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1241291611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdf434c-87d9-4b6a-8d16-9c63537c7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:09Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Creating volume 7fdf434c-87d9-4b6a-8d16-9c63537c7187 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:11 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:11 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4f52f9af-176c-4a3c-90f9-fdbed996434e tempest-CinderUnicodeTest-1805294582 None] Create snapshot completed successfully Sep 01 11:41:11 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 1073741824 Sep 01 11:41:11 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-074f57da-94a7-4e76-a15b-9bed7b35fc0f tempest-ProjectAdminTests-1329791750 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.923038482666, 'free_capacity_gb': 1773.923038482666, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87144) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 11:41:11 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 1073741824" returned: 0 in 0.500s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:11 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 Sep 01 11:41:11 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-e9620082-57a9-4169-b9a0-e082e9a12dbd-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-e9620082-57a9-4169-b9a0-e082e9a12dbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-quobyte-64a226bd-9061-404c-92c4-f8643f0a1b48" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:11 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187" returned: 0 in 0.310s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-64a226bd-9061-404c-92c4-f8643f0a1b48" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-quobyte-e9620082-57a9-4169-b9a0-e082e9a12dbd" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5375a527-bc49-4076-a81a-be3c3fe159b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c276410d-bc92-4f9a-8d76-e3c39e35cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-e9620082-57a9-4169-b9a0-e082e9a12dbd" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Deleting offline snapshot e9620082-57a9-4169-b9a0-e082e9a12dbd of volume 64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] snapshot_file for this snap is: volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:11 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Volume volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 (7fdf434c-87d9-4b6a-8d16-9c63537c7187): created successfully Sep 01 11:41:11 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c276410d-bc92-4f9a-8d76-e3c39e35cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (6ad8d5fa-c35b-4d66-9a75-6fee245031ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a5885-1b01-4564-8366-8512b9878109]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-341d8c6a-e7a2-448d-bfd2-1b1f2fa6e0bc tempest-ProjectReaderTests-770613076 None] Created volume successfully. Sep 01 11:41:12 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd Sep 01 11:41:12 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:12 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd" returned: 0 in 0.426s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a226bd-9061-404c-92c4-f8643f0a1b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce03e2b7-dd12-4bc1-a2ba-e3ab4bd022cd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-7fdf434c-87d9-4b6a-8d16-9c63537c7187-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Lock "cinder-7fdf434c-87d9-4b6a-8d16-9c63537c7187-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-quobyte-7fdf434c-87d9-4b6a-8d16-9c63537c7187" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:12 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 Sep 01 11:41:12 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-7fdf434c-87d9-4b6a-8d16-9c63537c7187" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dfb88e-3cd9-4f47-a3fa-83687a9b8cf7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:12 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 Sep 01 11:41:12 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:12 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48" returned: 0 in 0.423s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:12 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd Sep 01 11:41:12 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:13 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187" returned: 0 in 0.477s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:13 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187 Sep 01 11:41:13 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:13 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-7fdf434c-87d9-4b6a-8d16-9c63537c7187" returned: 0 in 0.280s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:13 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-7fdf434c-87d9-4b6a-8d16-9c63537c7187" released by "delete_volume" :: held 0.811s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd" returned: 0 in 0.530s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:13 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd Sep 01 11:41:13 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Created reservations ['dfa01fe0-601f-4fa7-a640-0636334edf26', '1b0e7fc4-f61f-470d-b12b-e55a5a150dcc', '30cf6227-a471-4fbe-b6a2-1fe2f4ddf385', 'd5684a02-95c2-4832-8376-8c92e6a9aa95'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:13 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:13 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:13 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48.e9620082-57a9-4169-b9a0-e082e9a12dbd" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-e9620082-57a9-4169-b9a0-e082e9a12dbd" released by "_delete_snapshot" :: held 1.932s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-64a226bd-9061-404c-92c4-f8643f0a1b48" released by "delete_snapshot" :: held 1.987s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:13 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:13 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Deleted volume successfully. Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b391cf72-e844-46cc-afc9-1ba1a11c5380 tempest-ProjectReaderTests-770613076 None] Lock "cinder-7fdf434c-87d9-4b6a-8d16-9c63537c7187-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Created reservations ['4b10e969-1fb3-4a14-b1db-fdcba82ead2b', '25b6d772-36f4-4f10-99cf-15bfcb4b5c09', 'eb98a986-63f1-4f88-b7f5-441ba44bb97d', '790f031c-cdd0-4b11-aa76-4686dd5dd7b0'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:14 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Delete snapshot completed successfully. Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-395e7e21-7607-4c8b-811e-95e8171ad17a tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-e9620082-57a9-4169-b9a0-e082e9a12dbd-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (65773ffb-40f2-4946-a020-4b96733cb448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00582bb7-fc83-4cd7-974d-31e4155993a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00582bb7-fc83-4cd7-974d-31e4155993a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456622219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a551888-c91c-47f5-925a-b3ef0776e0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:14Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487c2edd-a199-4a4f-8340-db3725b887e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487c2edd-a199-4a4f-8340-db3725b887e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66642841-5b8e-4459-bf7a-f8911a6ccff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66642841-5b8e-4459-bf7a-f8911a6ccff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a551888-c91c-47f5-925a-b3ef0776e0e9', 'volume_name': 'volume-4a551888-c91c-47f5-925a-b3ef0776e0e9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d1f052-ecf0-411c-b66a-0b3435799b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d1f052-ecf0-411c-b66a-0b3435799b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7712b342-1a0d-4e97-9201-3ff5ce9869c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:14 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Volume 4a551888-c91c-47f5-925a-b3ef0776e0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a551888-c91c-47f5-925a-b3ef0776e0e9', 'volume_size': 1} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456622219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a551888-c91c-47f5-925a-b3ef0776e0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11863a76b7e54f449dad7fb3b9dac240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:14Z,use_quota=True,user_id='7f5d5bb7c02c4c3aba249c8cc8e46558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Creating volume 4a551888-c91c-47f5-925a-b3ef0776e0e9 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:14 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:14 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 1073741824 Sep 01 11:41:14 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:14 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 1073741824" returned: 0 in 0.461s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:14 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 Sep 01 11:41:14 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-64a226bd-9061-404c-92c4-f8643f0a1b48-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-64a226bd-9061-404c-92c4-f8643f0a1b48-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-quobyte-64a226bd-9061-404c-92c4-f8643f0a1b48" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-64a226bd-9061-404c-92c4-f8643f0a1b48" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:15 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9" returned: 0 in 0.362s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7712b342-1a0d-4e97-9201-3ff5ce9869c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a551888-c91c-47f5-925a-b3ef0776e0e9', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f753194-a50c-4492-bd87-4976b33d36e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4cd83-aa68-45d0-9e48-d8061c092f9c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:15 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Volume volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 (4a551888-c91c-47f5-925a-b3ef0776e0e9): created successfully Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f753194-a50c-4492-bd87-4976b33d36e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Flow 'volume_create_manager' (65773ffb-40f2-4946-a020-4b96733cb448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:15 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1776f357-15dc-405a-98f9-4bb1221430bd tempest-ProjectReaderTests-770613076 None] Created volume successfully. Sep 01 11:41:15 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 Sep 01 11:41:15 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:15 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48" returned: 0 in 0.410s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:15 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48 Sep 01 11:41:15 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:16 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-64a226bd-9061-404c-92c4-f8643f0a1b48" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-64a226bd-9061-404c-92c4-f8643f0a1b48" released by "delete_volume" :: held 0.761s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Created reservations ['8b6f9b08-5eeb-4c27-b96f-04183329b503', '97fc85bc-f915-4ef1-bf59-da11e14afb23', '03796d8d-e43f-4f09-812d-d9f0a8c5235f', 'd351e3e6-bd5e-4e23-915a-91590c5bab4c'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:16 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:16 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-a9da23be-638a-464e-88c4-ca49e6bf193a-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-a9da23be-638a-464e-88c4-ca49e6bf193a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "cinder-quobyte-a9da23be-638a-464e-88c4-ca49e6bf193a" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:16 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.351s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-a9da23be-638a-464e-88c4-ca49e6bf193a" acquired by "delete_volume" :: waited 0.024s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-4a551888-c91c-47f5-925a-b3ef0776e0e9-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Deleted volume successfully. Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ef926-80e8-4f32-a93e-8676ff446974]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Lock "cinder-4a551888-c91c-47f5-925a-b3ef0776e0e9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-ae11d6ae-c132-4ccf-997d-99ac6810dfb1 tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-64a226bd-9061-404c-92c4-f8643f0a1b48-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Acquiring lock "cinder-quobyte-4a551888-c91c-47f5-925a-b3ef0776e0e9" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-4a551888-c91c-47f5-925a-b3ef0776e0e9" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c39feb-b502-479e-8558-b9c62af66bc0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:16 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a Sep 01 11:41:16 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:16 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 Sep 01 11:41:16 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:17 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a" returned: 0 in 0.517s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:17 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a Sep 01 11:41:17 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:17 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9" returned: 0 in 0.455s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:17 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9 Sep 01 11:41:17 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:17 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-a9da23be-638a-464e-88c4-ca49e6bf193a" returned: 0 in 0.319s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-quobyte-a9da23be-638a-464e-88c4-ca49e6bf193a" released by "delete_volume" :: held 0.918s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Created reservations ['d89074a1-3e03-4369-8651-0ae4e3fe4c2d', '69d68200-f1f0-4b3f-9536-bde0f309efa0', '254282c7-d0a2-47b8-b60b-81a8df193b14', '859ae538-4a3a-40e3-b3a0-16ed6be999af'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:17 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-4a551888-c91c-47f5-925a-b3ef0776e0e9" returned: 0 in 0.320s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Lock "cinder-quobyte-4a551888-c91c-47f5-925a-b3ef0776e0e9" released by "delete_volume" :: held 0.858s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:17 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:17 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:17 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Created reservations ['a141d4dd-42ef-4fde-b465-fb3b73e51510', '647d14ab-c8a6-4527-89aa-f3093d0d3bc9', '6d6f68d0-4466-4813-9e26-a795dd187cf8', '8a5f935e-e47f-478e-a4fb-029fc904f9b2'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:18 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:18 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:18 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.426s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Deleted volume successfully. Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-eaf64ea9-60bb-4f61-8f02-697c2426962e tempest-CinderUnicodeTest-1805294582 None] Lock "cinder-a9da23be-638a-464e-88c4-ca49e6bf193a-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:18 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.324s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:18 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Deleted volume successfully. Sep 01 11:41:18 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-81295595-b0cb-40e8-9aa0-666063308269 tempest-ProjectReaderTests-770613076 None] Lock "cinder-4a551888-c91c-47f5-925a-b3ef0776e0e9-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (b4507903-5fd5-4898-a786-2d56a1b3296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f347bc5d-2feb-410a-b30c-772046ffd083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f347bc5d-2feb-410a-b30c-772046ffd083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692292337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613a91e4-a509-4ed9-875b-d87c9d53639d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:22Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a450e1cd-3fb2-4c9b-9538-811da082f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a450e1cd-3fb2-4c9b-9538-811da082f634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb46fbb-3e69-4d21-8cfb-2b64bdd78dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb46fbb-3e69-4d21-8cfb-2b64bdd78dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613a91e4-a509-4ed9-875b-d87c9d53639d', 'volume_name': 'volume-613a91e4-a509-4ed9-875b-d87c9d53639d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d683801-ae54-4ac3-ae24-922fcb49617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d683801-ae54-4ac3-ae24-922fcb49617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d91109-8b6e-4912-b87b-51ab0e0e7930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:22 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Volume 613a91e4-a509-4ed9-875b-d87c9d53639d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613a91e4-a509-4ed9-875b-d87c9d53639d', 'volume_size': 1} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692292337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613a91e4-a509-4ed9-875b-d87c9d53639d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:22Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Creating volume 613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:22 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:22 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d 1073741824 Sep 01 11:41:22 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:23 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d 1073741824" returned: 0 in 0.575s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:23 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d Sep 01 11:41:23 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (89e10b51-ec57-47fa-86d5-6852fe0a75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9686e15f-f758-4694-98b4-218f92d2e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9686e15f-f758-4694-98b4-218f92d2e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350595100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d1437c-67bb-435b-bd51-a7edb347a7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:23Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21adea5c-7eb0-4f28-8b30-202bd4cc9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21adea5c-7eb0-4f28-8b30-202bd4cc9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdacd9b-8f68-49b8-b585-67dc885d2b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdacd9b-8f68-49b8-b585-67dc885d2b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d1437c-67bb-435b-bd51-a7edb347a7ae', 'volume_name': 'volume-21d1437c-67bb-435b-bd51-a7edb347a7ae', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7b84dc-12ed-4fa9-8ef0-e6c928286a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7b84dc-12ed-4fa9-8ef0-e6c928286a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d503966-ced8-495e-ae49-4701a057fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Volume 21d1437c-67bb-435b-bd51-a7edb347a7ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d1437c-67bb-435b-bd51-a7edb347a7ae', 'volume_size': 1} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:23 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350595100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d1437c-67bb-435b-bd51-a7edb347a7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:23Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Creating volume 21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:23 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d91109-8b6e-4912-b87b-51ab0e0e7930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613a91e4-a509-4ed9-875b-d87c9d53639d', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:23 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae 1073741824 Sep 01 11:41:23 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129d5962-abcd-48ab-bd71-9d15ef5ddd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Volume volume-613a91e4-a509-4ed9-875b-d87c9d53639d (613a91e4-a509-4ed9-875b-d87c9d53639d): created successfully Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129d5962-abcd-48ab-bd71-9d15ef5ddd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (b4507903-5fd5-4898-a786-2d56a1b3296f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:23 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b79093da-73bb-4345-b2d7-225fbb22db00 tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:41:23 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae 1073741824" returned: 0 in 0.416s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:23 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae Sep 01 11:41:23 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:24 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae" returned: 0 in 0.308s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d503966-ced8-495e-ae49-4701a057fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d1437c-67bb-435b-bd51-a7edb347a7ae', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4aebf6d-1fbd-4c38-b773-82df67f4f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:24 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Volume volume-21d1437c-67bb-435b-bd51-a7edb347a7ae (21d1437c-67bb-435b-bd51-a7edb347a7ae): created successfully Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4aebf6d-1fbd-4c38-b773-82df67f4f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (89e10b51-ec57-47fa-86d5-6852fe0a75f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-87141f1f-ee2f-452f-a2d6-a9ffb439ce8d tempest-ProjectReaderTests-1157578372 None] Created volume successfully. Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot 8258afac-8cdb-43b8-b527-315511dda786 of volume 613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c489c5-d8ac-449e-90fb-12a8818be445]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:24 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d Sep 01 11:41:24 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:25 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:25 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 1G Sep 01 11:41:25 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:25 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 1G" returned: 0 in 0.513s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a91e4-a509-4ed9-875b-d87c9d53639d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:25 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a91e4-a509-4ed9-875b-d87c9d53639d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 Sep 01 11:41:25 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:26 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a91e4-a509-4ed9-875b-d87c9d53639d -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786" returned: 0 in 0.368s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:26 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 is being set with open permissions: ugo+rw Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:26 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 Sep 01 11:41:26 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:26 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786" returned: 0 in 0.306s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:26 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info Sep 01 11:41:26 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:26 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:26 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info is being set with open permissions: ugo+rw Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:26 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info Sep 01 11:41:26 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:26 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.info" returned: 0 in 0.287s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.419s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Creating offline snapshot 8c694e90-0cbe-4526-bb5a-6e70568a4d3c of volume 21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:27 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3fd2147e-4cb3-4a21-b1e2-f30e70c162d9 tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a80b72-0290-4c13-b2dc-3f7d19d7a98b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:27 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae Sep 01 11:41:27 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:27 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae" returned: 0 in 0.407s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:27 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c 1G Sep 01 11:41:27 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:27 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-8258afac-8cdb-43b8-b527-315511dda786-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c 1G" returned: 0 in 0.483s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d1437c-67bb-435b-bd51-a7edb347a7ae -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-8258afac-8cdb-43b8-b527-315511dda786-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-613a91e4-a509-4ed9-875b-d87c9d53639d" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:27 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d1437c-67bb-435b-bd51-a7edb347a7ae -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c Sep 01 11:41:27 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-613a91e4-a509-4ed9-875b-d87c9d53639d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-8258afac-8cdb-43b8-b527-315511dda786" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-8258afac-8cdb-43b8-b527-315511dda786" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot 8258afac-8cdb-43b8-b527-315511dda786 of volume 613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3331143f-9edc-4162-a59c-d996a37d5ffb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:28 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 Sep 01 11:41:28 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:28 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d1437c-67bb-435b-bd51-a7edb347a7ae -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c" returned: 0 in 0.465s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:28 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c is being set with open permissions: ugo+rw Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:28 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c Sep 01 11:41:28 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:28 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786" returned: 0 in 0.537s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613a91e4-a509-4ed9-875b-d87c9d53639d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[06173aaa-2596-4e7f-8246-fa50a1c7dc07]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:28 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:28 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d Sep 01 11:41:28 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:28 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info Sep 01 11:41:28 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:29 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info" returned: 0 in 0.284s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:29 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info is being set with open permissions: ugo+rw Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:29 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:29 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info Sep 01 11:41:29 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:29 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 Sep 01 11:41:29 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:29 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.info" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c5c17b2e-aeef-4811-93ac-91d26df7492a tempest-ProjectReaderTests-1157578372 None] Create snapshot completed successfully Sep 01 11:41:29 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:29 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786 Sep 01 11:41:29 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:29 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d.8258afac-8cdb-43b8-b527-315511dda786" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-8258afac-8cdb-43b8-b527-315511dda786" released by "_delete_snapshot" :: held 1.799s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-613a91e4-a509-4ed9-875b-d87c9d53639d" released by "delete_snapshot" :: held 1.835s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Created reservations ['f7942061-a103-4eff-bf7a-cf2e33e9cc0a', '9b0aaf70-0d75-4aaf-a65f-a82169b8d98c', '1c8f863d-c02a-4957-9c25-515abc988339', 'e2b9b240-aefb-49b4-83be-62d43d6eb0c5'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:41:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c9bad7bf-2ab7-42dd-b3bd-6aae07eb8690 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-8258afac-8cdb-43b8-b527-315511dda786-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-613a91e4-a509-4ed9-875b-d87c9d53639d-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-8c694e90-0cbe-4526-bb5a-6e70568a4d3c-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-613a91e4-a509-4ed9-875b-d87c9d53639d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-8c694e90-0cbe-4526-bb5a-6e70568a4d3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-21d1437c-67bb-435b-bd51-a7edb347a7ae" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-21d1437c-67bb-435b-bd51-a7edb347a7ae" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-8c694e90-0cbe-4526-bb5a-6e70568a4d3c" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-613a91e4-a509-4ed9-875b-d87c9d53639d" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-8c694e90-0cbe-4526-bb5a-6e70568a4d3c" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Deleting offline snapshot 8c694e90-0cbe-4526-bb5a-6e70568a4d3c of volume 21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] snapshot_file for this snap is: volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e27de00-9152-4583-8aac-2e12033c75c9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-613a91e4-a509-4ed9-875b-d87c9d53639d" acquired by "delete_volume" :: waited 0.062s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929ee5a-f97b-40b7-9a14-55fc96232e6c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:30 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c Sep 01 11:41:30 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:30 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d Sep 01 11:41:30 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:30 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c" returned: 0 in 0.459s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21d1437c-67bb-435b-bd51-a7edb347a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:30 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d" returned: 0 in 0.438s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed6a94-3250-41ab-b346-801c18eef903]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:30 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d Sep 01 11:41:30 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:30 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae Sep 01 11:41:30 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:31 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-613a91e4-a509-4ed9-875b-d87c9d53639d" returned: 0 in 0.300s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-613a91e4-a509-4ed9-875b-d87c9d53639d" released by "delete_volume" :: held 0.805s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Created reservations ['11d28695-310e-436f-950b-43b43acc0d4e', '957584d0-042d-4170-8051-4571bb665272', '7f88d924-a897-4554-80d5-98d6e44e9e2e', '61f1e22e-3bde-4f05-ac44-3baf6b9a7ead'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:31 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae" returned: 0 in 0.407s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:31 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c Sep 01 11:41:31 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:31 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:31 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:31 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.309s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:41:31 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c" returned: 0 in 0.415s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:31 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c Sep 01 11:41:31 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3d62fdec-ab2d-4897-b3a0-fb8031ebb6a9 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-613a91e4-a509-4ed9-875b-d87c9d53639d-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:31 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae.8c694e90-0cbe-4526-bb5a-6e70568a4d3c" returned: 0 in 0.302s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-8c694e90-0cbe-4526-bb5a-6e70568a4d3c" released by "_delete_snapshot" :: held 1.748s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-21d1437c-67bb-435b-bd51-a7edb347a7ae" released by "delete_snapshot" :: held 1.807s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (51fd2303-84d2-44e3-ac1a-e897f9003f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b622de9a-1b93-41e9-822b-93052ed315dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b622de9a-1b93-41e9-822b-93052ed315dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712577627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc2d749-b8ae-42d4-b3db-1348be2eedd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:32Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a9d2b7-ed11-44ee-8907-825e5d79341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a9d2b7-ed11-44ee-8907-825e5d79341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d1b27f-46bd-48b9-92dc-fe8c65b120d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d1b27f-46bd-48b9-92dc-fe8c65b120d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc2d749-b8ae-42d4-b3db-1348be2eedd8', 'volume_name': 'volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5042bf13-4854-4df3-86cc-0f88091d8b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5042bf13-4854-4df3-86cc-0f88091d8b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284f142b-a437-4490-98b8-5cbed2f1888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Volume dfc2d749-b8ae-42d4-b3db-1348be2eedd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8', 'volume_size': 1} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712577627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc2d749-b8ae-42d4-b3db-1348be2eedd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:32Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Creating volume dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:32 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:32 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 1073741824 Sep 01 11:41:32 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Created reservations ['7f7c7570-d743-4e9a-afe4-3effb8728894', 'ec7d2b31-3409-4589-94e9-2c7ba5db3dfd', '3aefdc19-d13b-409d-9b71-50cabe88d717', '46c227d3-9050-4d8d-9952-fedcec2df60f'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:32 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Delete snapshot completed successfully. Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-76e06dab-32b0-48d3-b56a-1aa8c6b4d357 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-8c694e90-0cbe-4526-bb5a-6e70568a4d3c-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-21d1437c-67bb-435b-bd51-a7edb347a7ae-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Lock "cinder-21d1437c-67bb-435b-bd51-a7edb347a7ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-21d1437c-67bb-435b-bd51-a7edb347a7ae" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-21d1437c-67bb-435b-bd51-a7edb347a7ae" acquired by "delete_volume" :: waited 0.027s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d2cd0-9ccd-477c-a8e9-b43742a05b19]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:32 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae Sep 01 11:41:32 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:32 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 1073741824" returned: 0 in 0.505s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:32 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 Sep 01 11:41:32 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:32 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae" returned: 0 in 0.387s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:32 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae Sep 01 11:41:32 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:32 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" returned: 0 in 0.283s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284f142b-a437-4490-98b8-5cbed2f1888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:32 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45de297a-6d41-4d6c-a048-d2cca6650085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:32 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Volume volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 (dfc2d749-b8ae-42d4-b3db-1348be2eedd8): created successfully Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45de297a-6d41-4d6c-a048-d2cca6650085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (51fd2303-84d2-44e3-ac1a-e897f9003f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c7855c37-00ac-4c84-bdac-ba33139d54de tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:41:33 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-21d1437c-67bb-435b-bd51-a7edb347a7ae" returned: 0 in 0.312s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-21d1437c-67bb-435b-bd51-a7edb347a7ae" released by "delete_volume" :: held 0.760s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Created reservations ['c551616e-a923-45d9-ac81-45760f44728d', '493fe6ea-45fd-48dd-9c77-22a4e35bb97a', '98a7572a-da69-4e8c-943c-d0a95864e505', '2d931b20-f372-4910-a8d8-13d02ad0a95d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:33 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:33 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:33 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Deleted volume successfully. Sep 01 11:41:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aa69a1c2-a091-4bd1-bf5e-c0099751e14e tempest-ProjectReaderTests-1157578372 None] Lock "cinder-21d1437c-67bb-435b-bd51-a7edb347a7ae-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (c685bb35-8282-4402-9512-7a72c7ffe241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804c91ce-1f94-4ef4-bd8d-71da4fb9445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804c91ce-1f94-4ef4-bd8d-71da4fb9445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598565861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68891aab-4db9-43c1-9c47-c1eab181b0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:34Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f651f65c-115a-41af-a641-2b100a341d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f651f65c-115a-41af-a641-2b100a341d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c67b53d-554d-464e-9a54-123a9202124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c67b53d-554d-464e-9a54-123a9202124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68891aab-4db9-43c1-9c47-c1eab181b0ad', 'volume_name': 'volume-68891aab-4db9-43c1-9c47-c1eab181b0ad', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b599b3-fd8b-4ca4-a55c-b144889fe0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b599b3-fd8b-4ca4-a55c-b144889fe0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418b4741-965f-4375-aaaf-37f5e8b455c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:34 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Volume 68891aab-4db9-43c1-9c47-c1eab181b0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68891aab-4db9-43c1-9c47-c1eab181b0ad', 'volume_size': 1} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598565861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68891aab-4db9-43c1-9c47-c1eab181b0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:34Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Creating volume 68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:34 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:34 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad 1073741824 Sep 01 11:41:34 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:34 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad 1073741824" returned: 0 in 0.602s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:34 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad Sep 01 11:41:34 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:35 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad" returned: 0 in 0.304s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.815s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418b4741-965f-4375-aaaf-37f5e8b455c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68891aab-4db9-43c1-9c47-c1eab181b0ad', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0595ca8a-5167-4cbe-90d3-60a1283056a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot 6adbba39-189f-436a-96fb-1f23f2c4c67b of volume dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:35 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Volume volume-68891aab-4db9-43c1-9c47-c1eab181b0ad (68891aab-4db9-43c1-9c47-c1eab181b0ad): created successfully Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0595ca8a-5167-4cbe-90d3-60a1283056a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (c685bb35-8282-4402-9512-7a72c7ffe241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e4ac95-90ca-4117-9e11-86143fddae2a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-66105e90-0c1a-46dd-b65a-2fb2647fa9f6 tempest-ProjectReaderTests-1157578372 None] Created volume successfully. Sep 01 11:41:35 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 Sep 01 11:41:35 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:35 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" returned: 0 in 0.366s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:35 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b 1G Sep 01 11:41:35 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:35 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b 1G" returned: 0 in 0.464s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:36 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b Sep 01 11:41:36 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:36 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:36 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b is being set with open permissions: ugo+rw Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:36 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b Sep 01 11:41:36 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:36 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:36 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info Sep 01 11:41:36 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:36 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info" returned: 0 in 0.290s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:36 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info is being set with open permissions: ugo+rw Sep 01 11:41:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:36 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info Sep 01 11:41:36 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:37 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.info" returned: 0 in 0.331s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.991s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Creating offline snapshot eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 of volume 68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:37 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-41e78518-777a-4ee7-bc60-8a22140855d0 tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1302320-9dc5-493b-a2cb-57f028c01ce7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-6adbba39-189f-436a-96fb-1f23f2c4c67b-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-6adbba39-189f-436a-96fb-1f23f2c4c67b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-6adbba39-189f-436a-96fb-1f23f2c4c67b" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:37 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad Sep 01 11:41:37 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-6adbba39-189f-436a-96fb-1f23f2c4c67b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot 6adbba39-189f-436a-96fb-1f23f2c4c67b of volume dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef98ccaf-85d1-4449-bec2-98d5fb70b4c5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:37 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b Sep 01 11:41:37 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:37 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad" returned: 0 in 0.467s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:37 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 1G Sep 01 11:41:37 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:37 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b" returned: 0 in 0.417s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a014d-5830-4021-a1b0-232091a930a1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:38 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 Sep 01 11:41:38 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:38 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 1G" returned: 0 in 0.473s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68891aab-4db9-43c1-9c47-c1eab181b0ad -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:38 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68891aab-4db9-43c1-9c47-c1eab181b0ad -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 Sep 01 11:41:38 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:38 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" returned: 0 in 0.403s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:38 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b Sep 01 11:41:38 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:38 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68891aab-4db9-43c1-9c47-c1eab181b0ad -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" returned: 0 in 0.404s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:38 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 is being set with open permissions: ugo+rw Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:38 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 Sep 01 11:41:38 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:38 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b" returned: 0 in 0.409s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:38 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b Sep 01 11:41:38 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:38 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" returned: 0 in 0.256s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:39 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info Sep 01 11:41:39 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:39 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8.6adbba39-189f-436a-96fb-1f23f2c4c67b" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-6adbba39-189f-436a-96fb-1f23f2c4c67b" released by "_delete_snapshot" :: held 1.639s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" released by "delete_snapshot" :: held 1.673s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Created reservations ['9c8cb6c1-cab5-4831-a78a-14842f527b96', 'b03a3a3b-0576-4163-a0f7-08c44674103c', '51277c2c-983f-40b0-9199-31f3a859fabc', '6032b21a-40f3-48e1-815a-f3d999fa26da'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:39 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info" returned: 0 in 0.310s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:39 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info is being set with open permissions: ugo+rw Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:39 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info Sep 01 11:41:39 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-e73ee46a-9058-4aa1-809d-26ff83b228e8 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-6adbba39-189f-436a-96fb-1f23f2c4c67b-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:39 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.info" returned: 0 in 0.250s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:39 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-a9ead911-2062-4cd8-82c5-002d8c5a9ca7 tempest-ProjectReaderTests-1157578372 None] Create snapshot completed successfully Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-dfc2d749-b8ae-42d4-b3db-1348be2eedd8-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Lock "cinder-dfc2d749-b8ae-42d4-b3db-1348be2eedd8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[09601101-31bb-4871-92f7-3979f89dfefc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:39 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 Sep 01 11:41:39 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:40 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" returned: 0 in 0.390s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:40 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8 Sep 01 11:41:40 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:40 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-eb1fc3c2-3e1c-4a70-8b80-18478bcc4602-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-eb1fc3c2-3e1c-4a70-8b80-18478bcc4602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-68891aab-4db9-43c1-9c47-c1eab181b0ad" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-dfc2d749-b8ae-42d4-b3db-1348be2eedd8" released by "delete_volume" :: held 0.837s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-68891aab-4db9-43c1-9c47-c1eab181b0ad" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Deleting offline snapshot eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 of volume 68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] snapshot_file for this snap is: volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[761402de-e383-4a83-95f8-c0c8ae00fcda]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Created reservations ['b9433184-67dd-4dfc-a8cd-f304c15bac27', '8fd2714a-1fb4-4f36-9a5a-42c5c3018f61', '45df907c-88e2-4717-9fdb-d67f6c7aba2a', '0406a731-901a-4173-9015-1df0c7389f80'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:40 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:40 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:40 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 Sep 01 11:41:40 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:41 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.360s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:41 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:41:41 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" returned: 0 in 0.492s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68891aab-4db9-43c1-9c47-c1eab181b0ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-89a61375-9d01-46f9-982e-6e0bde0a350e tempest-ProjectMemberTests-1521081513 None] Lock "cinder-dfc2d749-b8ae-42d4-b3db-1348be2eedd8-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a1f2f8-365b-4620-b428-a8b6a6832318]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:41 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad Sep 01 11:41:41 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (d500ea23-8e3a-4c5f-b66a-8c77d700decf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b94b96c-8562-4a1b-ae05-383efab4d7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b94b96c-8562-4a1b-ae05-383efab4d7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195376516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba282db-d02f-4d22-8dbe-fdc81ba48d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:41Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e12150-6b8a-43ec-a5ca-6cb2a5f69366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e12150-6b8a-43ec-a5ca-6cb2a5f69366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c99417a-94b9-4031-a220-703aa1a652e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c99417a-94b9-4031-a220-703aa1a652e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba282db-d02f-4d22-8dbe-fdc81ba48d88', 'volume_name': 'volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cc2dc2-a692-4673-800b-4e4d916cfcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cc2dc2-a692-4673-800b-4e4d916cfcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877453df-8cf1-4515-aa8e-1bd41efaa636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:41 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Volume bba282db-d02f-4d22-8dbe-fdc81ba48d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88', 'volume_size': 1} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195376516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba282db-d02f-4d22-8dbe-fdc81ba48d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:41Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Creating volume bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:41 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:41 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 1073741824 Sep 01 11:41:41 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:41 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad" returned: 0 in 0.454s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:41 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 Sep 01 11:41:41 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Flow 'volume_create_manager' (fb76c1be-be97-4a6e-81d6-b5f3deee1569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7a09f1-7687-413f-a996-892e16bb6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7a09f1-7687-413f-a996-892e16bb6acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2095972264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b90a88ba20437aa5bd6ede83fbf21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:42Z,use_quota=True,user_id='210bb79cae4d47a5aca252a59126d174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9107c5-967f-4fae-8541-389784f415f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9107c5-967f-4fae-8541-389784f415f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12af2b0-9422-4d31-a5e7-3aaadae197c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:42 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12af2b0-9422-4d31-a5e7-3aaadae197c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc', 'volume_name': 'volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6c3667-440b-40b7-a6b0-9716725e5f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6c3667-440b-40b7-a6b0-9716725e5f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32e56a5-3388-4e2e-bf1d-7f207eff338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Volume 8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc', 'volume_size': 1} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:42 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 1073741824" returned: 0 in 0.505s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" returned: 0 in 0.383s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:42 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602 Sep 01 11:41:42 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:42 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 Sep 01 11:41:42 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:42 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad.eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" returned: 0 in 0.253s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:42 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-eb1fc3c2-3e1c-4a70-8b80-18478bcc4602" released by "_delete_snapshot" :: held 1.713s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-68891aab-4db9-43c1-9c47-c1eab181b0ad" released by "delete_snapshot" :: held 1.749s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2095972264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b90a88ba20437aa5bd6ede83fbf21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:42Z,use_quota=True,user_id='210bb79cae4d47a5aca252a59126d174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Creating volume 8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:42 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:42 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc 1073741824 Sep 01 11:41:42 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877453df-8cf1-4515-aa8e-1bd41efaa636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86acc5d8-6127-4131-896d-14fee4fa43b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:42 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Volume volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 (bba282db-d02f-4d22-8dbe-fdc81ba48d88): created successfully Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86acc5d8-6127-4131-896d-14fee4fa43b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (d500ea23-8e3a-4c5f-b66a-8c77d700decf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f23823b5-b4ca-43d6-83e2-ae7df9e8d0ca tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Created reservations ['cf93526a-a907-4268-8981-25b7e8f7a0e6', '69ec4505-9be0-4e8b-b54a-6a66c0489714', '19a58379-58ec-4c12-a4d8-4a41dbf702de', '0ad0b87f-83ce-4920-982e-c38cc66f2a9e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Delete snapshot completed successfully. Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5e92ea78-4809-4a5b-967c-bed356ebad61 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-eb1fc3c2-3e1c-4a70-8b80-18478bcc4602-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-68891aab-4db9-43c1-9c47-c1eab181b0ad-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Lock "cinder-68891aab-4db9-43c1-9c47-c1eab181b0ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-68891aab-4db9-43c1-9c47-c1eab181b0ad" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-68891aab-4db9-43c1-9c47-c1eab181b0ad" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:42 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc 1073741824" returned: 0 in 0.460s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08e827-ca2e-49d3-b94d-88012f524ad8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:42 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:41:42 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:43 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad Sep 01 11:41:43 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:43 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.241s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32e56a5-3388-4e2e-bf1d-7f207eff338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6538d9a3-4e8c-4308-886f-1d010ad40ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:43 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Volume volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc (8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc): created successfully Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6538d9a3-4e8c-4308-886f-1d010ad40ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Flow 'volume_create_manager' (fb76c1be-be97-4a6e-81d6-b5f3deee1569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-73f24f4f-c22f-489e-a24c-1666867321fc tempest-SnapshotDependencyTests-46835023 None] Created volume successfully. Sep 01 11:41:43 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad" returned: 0 in 0.367s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:43 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad Sep 01 11:41:43 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:43 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-68891aab-4db9-43c1-9c47-c1eab181b0ad" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-68891aab-4db9-43c1-9c47-c1eab181b0ad" released by "delete_volume" :: held 0.707s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Created reservations ['1103ba5d-a630-47a1-a31a-2d19e6a7eb34', '0c1574fe-b645-4308-9b87-c5509a59a0e7', '0503c44a-d375-42b0-a8b5-ec4b44da9789', '326794d5-9c98-422f-855b-0d6f49754f5d'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:43 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:43 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 of volume bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92f237b-a029-4612-8041-4fa50d760a6d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:43 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 Sep 01 11:41:43 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:44 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.316s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:44 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Deleted volume successfully. Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c3e37ecc-eac8-4750-b4e9-c0c7af30ce2c tempest-ProjectReaderTests-1157578372 None] Lock "cinder-68891aab-4db9-43c1-9c47-c1eab181b0ad-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:44 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88" returned: 0 in 0.480s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:44 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 1G Sep 01 11:41:44 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (29b72e18-1efa-4826-92dd-36d73ac1dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979f1b7d-3e8b-4736-823a-4999c459f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979f1b7d-3e8b-4736-823a-4999c459f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867666538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d96b01-feec-4f5e-81f9-3cf52cafdf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:45Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a9bad8-1958-4f19-973b-8cd81b5ba0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a9bad8-1958-4f19-973b-8cd81b5ba0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e8753e-c381-4501-974d-a03077a3ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e8753e-c381-4501-974d-a03077a3ff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d96b01-feec-4f5e-81f9-3cf52cafdf96', 'volume_name': 'volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd99e24f-ea73-406f-8cb0-7cfbea623c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd99e24f-ea73-406f-8cb0-7cfbea623c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b9c9fe-905f-4e27-b5fc-40cc9f643dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:44 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Volume b1d96b01-feec-4f5e-81f9-3cf52cafdf96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96', 'volume_size': 1} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:44 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 1G" returned: 0 in 0.445s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:44 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:44 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 Sep 01 11:41:44 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:45 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" returned: 0 in 0.285s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:45 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 is being set with open permissions: ugo+rw Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:45 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 Sep 01 11:41:45 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:45 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" returned: 0 in 0.249s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:45 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info Sep 01 11:41:45 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:45 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info" returned: 0 in 0.243s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:45 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info is being set with open permissions: ugo+rw Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:45 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info Sep 01 11:41:45 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:45 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.info" returned: 0 in 0.237s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.242s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Creating offline snapshot 93d92a5f-0005-4e67-99eb-40a82197d5e5 of volume 8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d7b77-af82-4b26-8e50-00037a1ca43b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:45 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:45 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-40ba169f-0e3a-46e0-9868-efbdc979a559 tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:41:45 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:41:45 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:46 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.344s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:46 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 1G Sep 01 11:41:46 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:46 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 1G" returned: 0 in 0.397s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:46 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 Sep 01 11:41:46 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:46 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5" returned: 0 in 0.288s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:46 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 is being set with open permissions: ugo+rw Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:46 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 Sep 01 11:41:46 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-c4755266-3b8b-4bbb-a1eb-0eed1b821ff1-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c4755266-3b8b-4bbb-a1eb-0eed1b821ff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-bba282db-d02f-4d22-8dbe-fdc81ba48d88" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-bba282db-d02f-4d22-8dbe-fdc81ba48d88" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:46 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 of volume bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410ff69-49bb-4201-b908-0078f7b83d74]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:47 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5" returned: 0 in 0.251s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:47 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 Sep 01 11:41:47 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:47 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info Sep 01 11:41:47 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:47 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:47 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:47 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info is being set with open permissions: ugo+rw Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7bf79-0772-4747-8458-142cc66d0ae6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:47 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info Sep 01 11:41:47 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:47 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 Sep 01 11:41:47 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:47 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.info" returned: 0 in 0.247s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867666538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d96b01-feec-4f5e-81f9-3cf52cafdf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:45Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Creating volume b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:47 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:47 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 1073741824 Sep 01 11:41:47 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:47 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-acb133ed-7fb5-47e1-95a9-504afdebc54f tempest-SnapshotDependencyTests-46835023 None] Create snapshot completed successfully Sep 01 11:41:47 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88" returned: 0 in 0.381s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:47 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:47 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 Sep 01 11:41:47 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:48 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" returned: 0 in 0.333s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:48 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 1073741824" returned: 0 in 0.466s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:48 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1 Sep 01 11:41:48 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:48 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 Sep 01 11:41:48 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:48 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88.c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:48 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c4755266-3b8b-4bbb-a1eb-0eed1b821ff1" released by "_delete_snapshot" :: held 1.448s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" returned: 0 in 0.251s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-bba282db-d02f-4d22-8dbe-fdc81ba48d88" released by "delete_snapshot" :: held 1.479s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b9c9fe-905f-4e27-b5fc-40cc9f643dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528b6576-9f8c-4d12-b7a3-a58401b8dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:48 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Volume volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 (b1d96b01-feec-4f5e-81f9-3cf52cafdf96): created successfully Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528b6576-9f8c-4d12-b7a3-a58401b8dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (29b72e18-1efa-4826-92dd-36d73ac1dae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f83cfea9-43a1-475a-a3bd-5924e4c4ba07 tempest-ProjectReaderTests-1157578372 None] Created volume successfully. Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Created reservations ['90be174b-f35a-4347-a1e7-0459b4086fd7', '8311482b-47c1-4a87-ab8d-06324c43818d', '244f7db6-5ffb-412f-88fc-594820d62811', '30752ed4-9cec-45b7-9a6e-119a87349233'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:48 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-04a53184-d517-4c6f-9821-4f211462e062 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c4755266-3b8b-4bbb-a1eb-0eed1b821ff1-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Creating offline snapshot 657f5b3a-ee4d-407e-a0f3-4f326287e9c5 of volume b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd55e4d-9cf5-4d1a-8ea6-0103a4422d79]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:48 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:49 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 Sep 01 11:41:49 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-bba282db-d02f-4d22-8dbe-fdc81ba48d88-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Lock "cinder-bba282db-d02f-4d22-8dbe-fdc81ba48d88-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-bba282db-d02f-4d22-8dbe-fdc81ba48d88" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-bba282db-d02f-4d22-8dbe-fdc81ba48d88" acquired by "delete_volume" :: waited 0.036s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:49 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Flow 'volume_create_manager' (69075e25-5559-4200-809e-4cffdc5aa5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb0cbe6-ad9c-416d-b1c7-2498b3e34d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e6c57-80bf-4b78-b1fe-e538551a275d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" returned: 0 in 0.460s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb0cbe6-ad9c-416d-b1c7-2498b3e34d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0d5884-8614-4423-a667-4bfd39f7877a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b90a88ba20437aa5bd6ede83fbf21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93d92a5f-0005-4e67-99eb-40a82197d5e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:49Z,use_quota=True,user_id='210bb79cae4d47a5aca252a59126d174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1608eae6-662f-4c34-802d-ddc6be1d1b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:49 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 1G Sep 01 11:41:49 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1608eae6-662f-4c34-802d-ddc6be1d1b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21928f6-f9c8-4c60-a904-5ae53088924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21928f6-f9c8-4c60-a904-5ae53088924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a0d5884-8614-4423-a667-4bfd39f7877a', 'volume_name': 'volume-5a0d5884-8614-4423-a667-4bfd39f7877a', 'volume_size': 1, 'snapshot_id': '93d92a5f-0005-4e67-99eb-40a82197d5e5'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136d16cc-0bfc-4ade-abf1-43f06d220b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136d16cc-0bfc-4ade-abf1-43f06d220b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b44620-e2ae-4626-b4cb-669702e2285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:49 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Volume 5a0d5884-8614-4423-a667-4bfd39f7877a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a0d5884-8614-4423-a667-4bfd39f7877a', 'volume_size': 1, 'snapshot_id': '93d92a5f-0005-4e67-99eb-40a82197d5e5'} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:49 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 Sep 01 11:41:49 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:49 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:49 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88 Sep 01 11:41:49 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:49 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 1G" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:49 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 Sep 01 11:41:49 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:49 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:49 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-bba282db-d02f-4d22-8dbe-fdc81ba48d88" returned: 0 in 0.273s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-bba282db-d02f-4d22-8dbe-fdc81ba48d88" released by "delete_volume" :: held 0.739s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Created reservations ['a8516b67-e84b-4485-a38d-885374d6ffbc', '7ce8a8a4-fd88-474f-bf5e-c2accf0363a0', 'a6e623e3-c280-4ae0-9657-33984df9b742', '81165ef2-8e92-42ad-9c93-6003d1c537f7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:50 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5" returned: 0 in 0.283s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:50 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 is being set with open permissions: ugo+rw Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:50 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 Sep 01 11:41:50 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:50 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:50 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:50 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:50 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info Sep 01 11:41:50 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:50 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.269s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:50 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-f5c0fbb3-fbce-4fcf-adbb-fb99094c2e5d tempest-ProjectMemberTests-1521081513 None] Lock "cinder-bba282db-d02f-4d22-8dbe-fdc81ba48d88-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:50 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info" returned: 0 in 0.282s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:50 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info is being set with open permissions: ugo+rw Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:50 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info Sep 01 11:41:50 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (83882842-51b0-4e22-8839-c2453d35c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8d0642-0905-44c3-9afc-da8454662e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8d0642-0905-44c3-9afc-da8454662e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544691543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b3c678-cb5b-43d8-8b20-c063d9fe9a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:51Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b030768a-dbdc-4498-82f1-060087322e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b030768a-dbdc-4498-82f1-060087322e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523328c0-d2e7-4d01-a926-0416bdf4cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523328c0-d2e7-4d01-a926-0416bdf4cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b3c678-cb5b-43d8-8b20-c063d9fe9a88', 'volume_name': 'volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de09f4fc-ab28-4f6c-b4db-bc74662ce6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de09f4fc-ab28-4f6c-b4db-bc74662ce6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2008bc8-99e8-4b6c-a7c8-e5d97901b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:50 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Volume d4b3c678-cb5b-43d8-8b20-c063d9fe9a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88', 'volume_size': 1} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:50 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.info" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.501s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-quobyte-93d92a5f-0005-4e67-99eb-40a82197d5e5-5a0d5884-8614-4423-a667-4bfd39f7877a" by "_create_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:50 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6be9540b-aaca-433d-b547-d5993e12c282 tempest-ProjectReaderTests-1157578372 None] Create snapshot completed successfully Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-93d92a5f-0005-4e67-99eb-40a82197d5e5-5a0d5884-8614-4423-a667-4bfd39f7877a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Creating volume 5a0d5884-8614-4423-a667-4bfd39f7877a from snapshot 93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-quobyte-5a0d5884-8614-4423-a667-4bfd39f7877a" by "_copy_volume_from_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-5a0d5884-8614-4423-a667-4bfd39f7877a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:50 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] snapshot: 93d92a5f-0005-4e67-99eb-40a82197d5e5, volume: 5a0d5884-8614-4423-a667-4bfd39f7877a, {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e5f9cb-9ac9-462c-9221-bd02d8591699]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:51 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 Sep 01 11:41:51 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:51 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5" returned: 0 in 0.354s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Creating direct copy from snapshot {{(pid=87144) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a45f04-1ad8-4acb-b108-ed90a53e18a0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:51 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:41:51 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:51 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.354s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG cinder.utils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Path /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a not found in is_blk_device check {{(pid=87144) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 01 11:41:51 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:51 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a Sep 01 11:41:51 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-657f5b3a-ee4d-407e-a0f3-4f326287e9c5-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Lock "cinder-657f5b3a-ee4d-407e-a0f3-4f326287e9c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-657f5b3a-ee4d-407e-a0f3-4f326287e9c5" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-657f5b3a-ee4d-407e-a0f3-4f326287e9c5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Deleting offline snapshot 657f5b3a-ee4d-407e-a0f3-4f326287e9c5 of volume b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] snapshot_file for this snap is: volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[97267d4a-239c-4723-9d6a-01673fde115a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:52 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 Sep 01 11:41:52 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:52 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5" returned: 0 in 0.605s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b23a23-db7e-4f76-a677-344554b2afc0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:52 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:53 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 Sep 01 11:41:53 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:53 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" returned: 0 in 0.782s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:53 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:53 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 Sep 01 11:41:53 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:54 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5" returned: 0 in 0.578s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:54 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5 Sep 01 11:41:54 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:54 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:54 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96.657f5b3a-ee4d-407e-a0f3-4f326287e9c5" returned: 0 in 0.476s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-657f5b3a-ee4d-407e-a0f3-4f326287e9c5" released by "_delete_snapshot" :: held 2.650s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:54 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" released by "delete_snapshot" :: held 2.677s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:54 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Created reservations ['ff927829-5ce4-40e7-ba41-ea67911cb180', 'c0a45651-9ca8-41a8-9e2a-c7b742a8bb61', '895ce521-84ac-4fb5-a72b-507765b6e725', '47f28735-c665-4531-9ac7-c51addb623b0'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:55 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Delete snapshot completed successfully. Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6c6c0c81-4de9-4488-8c8f-6fc93d5ad09b tempest-ProjectReaderTests-1157578372 None] Lock "cinder-657f5b3a-ee4d-407e-a0f3-4f326287e9c5-delete_snapshot" released by "delete_snapshot" :: held 3.020s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-b1d96b01-feec-4f5e-81f9-3cf52cafdf96-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Lock "cinder-b1d96b01-feec-4f5e-81f9-3cf52cafdf96-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" acquired by "delete_volume" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b1d51-518e-4102-8cd6-327ec3344147]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:55 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:55 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 Sep 01 11:41:55 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:56 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" returned: 0 in 0.519s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:56 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96 Sep 01 11:41:56 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:56 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a" returned: 0 in 4.692s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc272167-ba77-48d9-9b4a-3dacc46c3bc1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:56 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" returned: 0 in 0.325s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-b1d96b01-feec-4f5e-81f9-3cf52cafdf96" released by "delete_volume" :: held 0.957s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:56 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:41:56 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Created reservations ['951f8044-bed4-4af6-b93f-397fa6e34096', '23fd3613-f028-445b-9097-02aa2bf1de05', '37d9fee4-ef4f-47c7-9e6d-ecfde27bab7c', '1167550f-504e-44c3-9904-f22132bb72bf'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:56 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:41:56 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:56 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:41:56 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Deleted volume successfully. Sep 01 11:41:56 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b0277c36-6db8-49d4-8009-5f5b8033809d tempest-ProjectReaderTests-1157578372 None] Lock "cinder-b1d96b01-feec-4f5e-81f9-3cf52cafdf96-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:57 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.610s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.image.image_utils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Image conversion details: src /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a {{(pid=87144) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 11:41:57 devstack cinder-volume[87144]: INFO cinder.image.image_utils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Converted 1024.00 MB image at 218.18 MB/s Sep 01 11:41:57 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a is being set with open permissions: ugo+rw Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:57 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a Sep 01 11:41:57 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (ab26b683-d016-4341-a5ee-8335c2d60f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dd730-37b4-4b11-9a6a-a2edac8ac4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dd730-37b4-4b11-9a6a-a2edac8ac4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543226573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b20c09-7561-4c4d-aecd-23a0060ce7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:57Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7cea30-cbd9-4fef-8600-a6c86291cf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7cea30-cbd9-4fef-8600-a6c86291cf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0306934d-6e73-464e-a979-b294607ae077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0306934d-6e73-464e-a979-b294607ae077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b20c09-7561-4c4d-aecd-23a0060ce7d8', 'volume_name': 'volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de617a7e-d25b-4e7b-868a-feb68c26cb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de617a7e-d25b-4e7b-868a-feb68c26cb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1baeee42-e32f-47b2-8937-b98ce61e78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:57 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Volume 13b20c09-7561-4c4d-aecd-23a0060ce7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8', 'volume_size': 1} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:57 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a" returned: 0 in 0.256s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-5a0d5884-8614-4423-a667-4bfd39f7877a" released by "_copy_volume_from_snapshot" :: held 6.346s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-93d92a5f-0005-4e67-99eb-40a82197d5e5-5a0d5884-8614-4423-a667-4bfd39f7877a" released by "_create_volume_from_snapshot" :: held 6.380s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.410s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.467s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544691543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b3c678-cb5b-43d8-8b20-c063d9fe9a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:51Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Creating volume d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:57 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:57 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 1073741824 Sep 01 11:41:57 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b44620-e2ae-4626-b4cb-669702e2285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0d5884-8614-4423-a667-4bfd39f7877a', 'volume_size': 1, 'snapshot_id': '93d92a5f-0005-4e67-99eb-40a82197d5e5'}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12ba21d-9c51-47aa-9e5e-c92191b81e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:57 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Volume volume-5a0d5884-8614-4423-a667-4bfd39f7877a (5a0d5884-8614-4423-a667-4bfd39f7877a): created successfully Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12ba21d-9c51-47aa-9e5e-c92191b81e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Flow 'volume_create_manager' (69075e25-5559-4200-809e-4cffdc5aa5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:57 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-77dafb84-b458-4110-ad88-25906967cd8a tempest-SnapshotDependencyTests-46835023 None] Created volume successfully. Sep 01 11:41:57 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 1073741824" returned: 0 in 0.404s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:57 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:57 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 Sep 01 11:41:57 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:58 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" returned: 0 in 0.266s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543226573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b20c09-7561-4c4d-aecd-23a0060ce7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:41:57Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Creating volume 13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:41:58 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2008bc8-99e8-4b6c-a7c8-e5d97901b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:58 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 1073741824 Sep 01 11:41:58 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b47b3c9-a8cd-4b02-bf0e-5d8597f66c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:58 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Volume volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 (d4b3c678-cb5b-43d8-8b20-c063d9fe9a88): created successfully Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b47b3c9-a8cd-4b02-bf0e-5d8597f66c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (83882842-51b0-4e22-8839-c2453d35c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-2ec31dfd-3ae9-49d5-a18e-20badcd18e62 tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-93d92a5f-0005-4e67-99eb-40a82197d5e5-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-93d92a5f-0005-4e67-99eb-40a82197d5e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-quobyte-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-quobyte-93d92a5f-0005-4e67-99eb-40a82197d5e5" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-93d92a5f-0005-4e67-99eb-40a82197d5e5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Deleting offline snapshot 93d92a5f-0005-4e67-99eb-40a82197d5e5 of volume 8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] snapshot_file for this snap is: volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[9019d916-1a8f-4506-818c-c27c828736e8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:58 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 Sep 01 11:41:58 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:58 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 1073741824" returned: 0 in 0.483s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:58 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 Sep 01 11:41:58 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:58 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5" returned: 0 in 0.400s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5813e767-c345-4ffe-b599-47b264d45474]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:58 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:41:58 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:58 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8" returned: 0 in 0.276s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.132s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1baeee42-e32f-47b2-8937-b98ce61e78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3046c4-0f11-4ae9-8cb8-675f489c02d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot c2af65b6-9757-4bce-8b56-472c939ae299 of volume d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a2c5a2-4941-4bae-836f-a531c2615fbe]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:58 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Volume volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 (13b20c09-7561-4c4d-aecd-23a0060ce7d8): created successfully Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3046c4-0f11-4ae9-8cb8-675f489c02d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:41:58 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (ab26b683-d016-4341-a5ee-8335c2d60f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:41:58 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-184a2f65-af64-43ef-85dc-04d958cd4b69 tempest-ProjectReaderTests-1157578372 None] Created volume successfully. Sep 01 11:41:59 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 Sep 01 11:41:59 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:59 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.375s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:59 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 Sep 01 11:41:59 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:59 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" returned: 0 in 0.406s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:59 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 1G Sep 01 11:41:59 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:41:59 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5" returned: 0 in 0.402s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:59 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5 Sep 01 11:41:59 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:59 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 1G" returned: 0 in 0.417s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:41:59 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc.93d92a5f-0005-4e67-99eb-40a82197d5e5" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:41:59 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 Sep 01 11:41:59 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-93d92a5f-0005-4e67-99eb-40a82197d5e5" released by "_delete_snapshot" :: held 1.589s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" released by "delete_snapshot" :: held 1.609s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Created reservations ['395b1473-be23-4c7b-b4db-81689802343d', 'd7720eb4-02a9-4c94-b016-62ba8601783f', 'dbdd8ea0-d48c-4fc7-8408-49615d4bcaaf', '0736a8d1-bf2d-4be0-b81a-81e33b8950f9'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:41:59 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Delete snapshot completed successfully. Sep 01 11:41:59 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3c5e1f65-f71c-4c49-95c9-d66222ac2a68 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-93d92a5f-0005-4e67-99eb-40a82197d5e5-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:00 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299" returned: 0 in 0.289s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:00 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 is being set with open permissions: ugo+rw Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:00 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 Sep 01 11:42:00 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:00 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299" returned: 0 in 0.239s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:00 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info Sep 01 11:42:00 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-quobyte-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232c681-c12a-4acc-bf3e-4091e82a6841]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:00 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:00 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info is being set with open permissions: ugo+rw Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:00 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:42:00 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:00 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info Sep 01 11:42:00 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:00 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.info" returned: 0 in 0.261s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:00 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.400s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.386s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Creating offline snapshot 07ff3615-eb3d-4e33-b5c4-9e1926588d6c of volume 13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:00 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc Sep 01 11:42:00 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:00 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3717045c-a5d2-4137-ae55-db40b199a786 tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c83c5c-ada0-4e0b-9d29-c6fac5ec7dd5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:00 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:01 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 Sep 01 11:42:01 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:01 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" returned: 0 in 0.253s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc" released by "delete_volume" :: held 0.707s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Created reservations ['b74eb934-5583-40be-b037-5bf19411c50b', '4ac323b6-8ee2-4fb8-9917-2ee8f30b0131', 'c9be084c-e095-4583-bc79-6e05b86ff475', '95f57716-5975-4faa-94f3-b28098914d55'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:01 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8" returned: 0 in 0.359s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:01 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:01 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:01 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c 1G Sep 01 11:42:01 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:01 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-5a0d5884-8614-4423-a667-4bfd39f7877a-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:01 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Deleted volume successfully. Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-5a0d5884-8614-4423-a667-4bfd39f7877a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b1ded57c-6f74-486d-b60f-324130fc1955 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-8fdf73e1-5673-4d4f-9518-d4bb66e5b1bc-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "cinder-quobyte-5a0d5884-8614-4423-a667-4bfd39f7877a" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-5a0d5884-8614-4423-a667-4bfd39f7877a" acquired by "delete_volume" :: waited 0.021s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba82424e-2491-462f-9ee5-273ecf9401df]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:01 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c 1G" returned: 0 in 0.457s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:01 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c Sep 01 11:42:01 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:01 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a Sep 01 11:42:01 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-c2af65b6-9757-4bce-8b56-472c939ae299-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c2af65b6-9757-4bce-8b56-472c939ae299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-c2af65b6-9757-4bce-8b56-472c939ae299" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c2af65b6-9757-4bce-8b56-472c939ae299" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot c2af65b6-9757-4bce-8b56-472c939ae299 of volume d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:01 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5b160-45fa-4e0b-bc99-6deb82534e17]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a" returned: 0 in 0.400s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c" returned: 0 in 0.333s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c is being set with open permissions: ugo+rw Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a Sep 01 11:42:02 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c Sep 01 11:42:02 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 Sep 01 11:42:02 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-5a0d5884-8614-4423-a667-4bfd39f7877a" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c" returned: 0 in 0.260s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-quobyte-5a0d5884-8614-4423-a667-4bfd39f7877a" released by "delete_volume" :: held 0.725s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info Sep 01 11:42:02 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299" returned: 0 in 0.396s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Created reservations ['e1a955b3-cc67-4039-9099-9cce921d85e6', 'fc102618-ed6a-484a-9207-9fb676f172fb', '9afd5841-c91f-4a82-b8fd-b8c4ea21bd21', '715b24ed-9b47-4386-a0f9-c82b170c17d7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd90525-c832-4c19-999f-0ffeb116e31a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:02 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 Sep 01 11:42:02 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info" returned: 0 in 0.298s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info is being set with open permissions: ugo+rw Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info Sep 01 11:42:02 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:02 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Deleted volume successfully. Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-5bb9d4c1-101b-45c6-8131-1cfa3a0898b9 tempest-SnapshotDependencyTests-46835023 None] Lock "cinder-5a0d5884-8614-4423-a667-4bfd39f7877a-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:02 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:02 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 Sep 01 11:42:02 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:02 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.info" returned: 0 in 0.294s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:02 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:03 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-73284d10-596f-41ed-99ae-783da12d791b tempest-ProjectReaderTests-1157578372 None] Create snapshot completed successfully Sep 01 11:42:03 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299" returned: 0 in 0.377s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:03 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299 Sep 01 11:42:03 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:03 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88.c2af65b6-9757-4bce-8b56-472c939ae299" returned: 0 in 0.272s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c2af65b6-9757-4bce-8b56-472c939ae299" released by "_delete_snapshot" :: held 1.582s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" released by "delete_snapshot" :: held 1.610s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Created reservations ['299c83df-b14f-4480-b752-ede02a001d38', '2b16f2fa-3aa6-4d87-8293-57e170ecad1a', 'c3b6a68a-6352-4dd5-9f48-4112923c4c0c', 'ccb936ae-30db-4e2b-9dc1-f812bbc267f8'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-07ff3615-eb3d-4e33-b5c4-9e1926588d6c-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-07ff3615-eb3d-4e33-b5c4-9e1926588d6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-13b20c09-7561-4c4d-aecd-23a0060ce7d8" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:03 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-13b20c09-7561-4c4d-aecd-23a0060ce7d8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-07ff3615-eb3d-4e33-b5c4-9e1926588d6c" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-af5a4c90-ad11-4093-9c66-8672b4bfc93f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c2af65b6-9757-4bce-8b56-472c939ae299-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-07ff3615-eb3d-4e33-b5c4-9e1926588d6c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Deleting offline snapshot 07ff3615-eb3d-4e33-b5c4-9e1926588d6c of volume 13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] snapshot_file for this snap is: volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[817215ef-ed73-4470-a4fc-40c84a238cdd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:03 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:03 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c Sep 01 11:42:03 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:04 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c" returned: 0 in 0.424s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b0e23-e081-4767-afb6-4c9eecdafd34]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d86856-5ed0-442e-b9c7-1dab0eee1254]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:04 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 Sep 01 11:42:04 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:04 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 Sep 01 11:42:04 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:04 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:04 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:04 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8" returned: 0 in 0.415s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:04 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" returned: 0 in 0.452s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:04 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c Sep 01 11:42:04 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:04 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88 Sep 01 11:42:04 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:04 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.305s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 11:42:04 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" returned: 0 in 0.283s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:04 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88" released by "delete_volume" :: held 0.807s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Created reservations ['c9db3f29-ac0e-4594-8729-b91a4bcd0782', 'f61085a2-d824-48d8-b434-804b0817dc1b', '9e83686a-fb4a-4059-80f0-cd39f6dc4937', 'f6aac76d-65f6-46a8-84ff-f148dc8ace12'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:05 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c" returned: 0 in 0.391s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:05 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c Sep 01 11:42:05 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:05 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:05 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:05 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8.07ff3615-eb3d-4e33-b5c4-9e1926588d6c" returned: 0 in 0.275s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-07ff3615-eb3d-4e33-b5c4-9e1926588d6c" released by "_delete_snapshot" :: held 1.624s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-13b20c09-7561-4c4d-aecd-23a0060ce7d8" released by "delete_snapshot" :: held 1.649s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:05 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.310s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-cc4f0657-867c-43f5-8c52-ee196d7f9c97 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-d4b3c678-cb5b-43d8-8b20-c063d9fe9a88-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Created reservations ['3d1474b7-b6e3-4196-92d0-b20bdb5aa25b', 'afda8fae-bc0b-498f-b1d0-e44f9494392f', '2995d581-d904-401b-a8d7-d419c69140f9', 'd211a218-56e5-4138-8765-b7fb13a7ffaf'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:05 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Delete snapshot completed successfully. Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-d5ac7f9f-73c0-4246-9874-e221b1d6b3f9 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-07ff3615-eb3d-4e33-b5c4-9e1926588d6c-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (d61b6ff3-1b47-4220-98ef-a35603ad4e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab7fd4a-c17e-4fd6-bf70-dd75bb97c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-13b20c09-7561-4c4d-aecd-23a0060ce7d8-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab7fd4a-c17e-4fd6-bf70-dd75bb97c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983228803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03b9f29-c6ad-415f-97ee-0d7fe414120c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:06Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a14948-88fd-43e5-a19d-b3670532ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a14948-88fd-43e5-a19d-b3670532ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccab347-b996-401f-9990-6b9b273749af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccab347-b996-401f-9990-6b9b273749af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03b9f29-c6ad-415f-97ee-0d7fe414120c', 'volume_name': 'volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f682a3b-9a28-4fa3-890e-3846ade21fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f682a3b-9a28-4fa3-890e-3846ade21fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf398a6-4daf-4b63-93a5-97e1df9a727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:05 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Volume c03b9f29-c6ad-415f-97ee-0d7fe414120c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c', 'volume_size': 1} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983228803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03b9f29-c6ad-415f-97ee-0d7fe414120c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:06Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Creating volume c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:42:05 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-13b20c09-7561-4c4d-aecd-23a0060ce7d8-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:05 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c 1073741824 Sep 01 11:42:05 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:05 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-13b20c09-7561-4c4d-aecd-23a0060ce7d8" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-13b20c09-7561-4c4d-aecd-23a0060ce7d8" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c61021-6d55-4782-9115-6b79bb2782b6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:06 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 Sep 01 11:42:06 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:06 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c 1073741824" returned: 0 in 0.418s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:06 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8" returned: 0 in 0.364s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:06 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8 Sep 01 11:42:06 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:06 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c Sep 01 11:42:06 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:06 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf398a6-4daf-4b63-93a5-97e1df9a727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fd3da1-79a3-4781-8517-727fb2202664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:06 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:UPDATE=246,cinder:SELECT=188,cinder:INSERT=57,cinder:DELETE=14 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-13b20c09-7561-4c4d-aecd-23a0060ce7d8" returned: 0 in 0.342s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:06 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Volume volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c (c03b9f29-c6ad-415f-97ee-0d7fe414120c): created successfully Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fd3da1-79a3-4781-8517-727fb2202664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (d61b6ff3-1b47-4220-98ef-a35603ad4e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-13b20c09-7561-4c4d-aecd-23a0060ce7d8" released by "delete_volume" :: held 0.772s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:DELETE=24,cinder:UPDATE=209,cinder:INSERT=62,cinder:SELECT=163 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:42:06 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d2ffd0f3-86c2-4893-a135-b58d3db788cb tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Created reservations ['53c59fbc-b015-4a19-b400-f8a43d78e9dc', '4a19be97-dc7f-4e4e-8002-4a09d480d5e7', 'f24167e5-e50f-418d-9de3-ce04930002a4', '681add45-681a-4515-9fd9-62af90c25098'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:06 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:06 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:06 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:07 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.267s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:07 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Deleted volume successfully. Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-be96fb76-c1d3-44c8-9f9d-e4c8d0031690 tempest-ProjectReaderTests-1157578372 None] Lock "cinder-13b20c09-7561-4c4d-aecd-23a0060ce7d8-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (20ead0d6-6f0d-40d0-b145-067300c34904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e17d8e-2391-4b82-b7b2-71d499e65da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e17d8e-2391-4b82-b7b2-71d499e65da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321748204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6262b3b-92b7-4fc9-acec-b5a9ceed74fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:07Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d4e8c6-b0ef-42df-9b85-6550070d69ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d4e8c6-b0ef-42df-9b85-6550070d69ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff7536c-0a15-43f6-8aa7-e9df953cc8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff7536c-0a15-43f6-8aa7-e9df953cc8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6262b3b-92b7-4fc9-acec-b5a9ceed74fa', 'volume_name': 'volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c971969e-f233-4f5a-af6b-560de4071a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c971969e-f233-4f5a-af6b-560de4071a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05418a18-ea86-472c-bc24-0c3af1b4c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:07 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Volume f6262b3b-92b7-4fc9-acec-b5a9ceed74fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa', 'volume_size': 1} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321748204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6262b3b-92b7-4fc9-acec-b5a9ceed74fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83de9adb1464839848d9a037ecc9bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:07Z,use_quota=True,user_id='9f39159decf14a4e983fccb86ddc4c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Creating volume f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:42:07 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:42:07 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:07 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa 1073741824 Sep 01 11:42:07 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:08 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa 1073741824" returned: 0 in 0.496s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:08 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa Sep 01 11:42:08 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:08 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.333s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05418a18-ea86-472c-bc24-0c3af1b4c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a1452a-ab0a-42a0-9d05-1ad9917fedef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot 621ddc4a-4986-4284-b6a7-63a98d488dd3 of volume c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:08 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Volume volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa (f6262b3b-92b7-4fc9-acec-b5a9ceed74fa): created successfully Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a1452a-ab0a-42a0-9d05-1ad9917fedef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Flow 'volume_create_manager' (20ead0d6-6f0d-40d0-b145-067300c34904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d329de2b-e9bd-4d81-bffc-1e2f98576edd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:08 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-0df8f889-e6f4-4901-998d-ad64c3c3e1e0 tempest-ProjectReaderTests-1157578372 None] Created volume successfully. Sep 01 11:42:08 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c Sep 01 11:42:08 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:08 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c" returned: 0 in 0.370s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:08 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:08 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 1G Sep 01 11:42:08 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:09 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 1G" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:09 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 Sep 01 11:42:09 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:09 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:09 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 is being set with open permissions: ugo+rw Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:09 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 Sep 01 11:42:09 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:09 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3" returned: 0 in 0.273s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:09 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:09 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info Sep 01 11:42:09 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:10 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info" returned: 0 in 0.278s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:10 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info is being set with open permissions: ugo+rw Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:10 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info Sep 01 11:42:10 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:10 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.info" returned: 0 in 0.242s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.718s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Creating offline snapshot fdb7b4f8-0dae-4c6e-80cc-0664977d99df of volume f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd171aa-9853-428a-88ca-a4d1d605fc90]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:10 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-fc01b767-f033-4d44-8760-7c8897d70c64 tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:42:10 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa Sep 01 11:42:10 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:10 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" returned: 0 in 0.372s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:10 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:10 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df 1G Sep 01 11:42:10 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-621ddc4a-4986-4284-b6a7-63a98d488dd3-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-621ddc4a-4986-4284-b6a7-63a98d488dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-c03b9f29-c6ad-415f-97ee-0d7fe414120c" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c03b9f29-c6ad-415f-97ee-0d7fe414120c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-621ddc4a-4986-4284-b6a7-63a98d488dd3" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:11 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df 1G" returned: 0 in 0.511s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-621ddc4a-4986-4284-b6a7-63a98d488dd3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot 621ddc4a-4986-4284-b6a7-63a98d488dd3 of volume c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:11 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df Sep 01 11:42:11 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb76c53-009b-47b9-b398-5c8a19323254]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:11 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 Sep 01 11:42:11 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:11 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df" returned: 0 in 0.345s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:11 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df is being set with open permissions: ugo+rw Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:11 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df Sep 01 11:42:11 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:11 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b2415-8780-4980-82b9-100c70c70021]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:11 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:12 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df" returned: 0 in 0.292s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:12 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c Sep 01 11:42:12 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:12 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info Sep 01 11:42:12 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:12 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info" returned: 0 in 0.286s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:12 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info is being set with open permissions: ugo+rw Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:12 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c" returned: 0 in 0.440s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:12 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info Sep 01 11:42:12 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:12 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 Sep 01 11:42:12 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:12 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.info" returned: 0 in 0.271s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:12 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-edd1d093-b78e-4d3b-9dcb-c8a9a9e24113 tempest-ProjectReaderTests-1157578372 None] Create snapshot completed successfully Sep 01 11:42:12 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3" returned: 0 in 0.393s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:12 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3 Sep 01 11:42:12 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:12 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-fdb7b4f8-0dae-4c6e-80cc-0664977d99df-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-fdb7b4f8-0dae-4c6e-80cc-0664977d99df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-fdb7b4f8-0dae-4c6e-80cc-0664977d99df" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-fdb7b4f8-0dae-4c6e-80cc-0664977d99df" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Deleting offline snapshot fdb7b4f8-0dae-4c6e-80cc-0664977d99df of volume f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:13 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] snapshot_file for this snap is: volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c.621ddc4a-4986-4284-b6a7-63a98d488dd3" returned: 0 in 0.302s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c4b76-4272-4ba4-a3fb-bcfed51d3030]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-621ddc4a-4986-4284-b6a7-63a98d488dd3" released by "_delete_snapshot" :: held 1.706s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c03b9f29-c6ad-415f-97ee-0d7fe414120c" released by "delete_snapshot" :: held 1.747s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Created reservations ['0dd389b5-5064-4011-9cba-db2497e255b4', '06b6c08f-5616-4e6f-8042-b6e4dbce630b', '94887b00-72b2-494e-8c8f-31b5ab7e095a', '50a35e94-59e8-48ab-8b16-da77e0739d45'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:13 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df Sep 01 11:42:13 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:13 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-24dd0116-4dc7-45c2-88f8-df9e0ace4d6f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-621ddc4a-4986-4284-b6a7-63a98d488dd3-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:13 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df" returned: 0 in 0.384s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-c03b9f29-c6ad-415f-97ee-0d7fe414120c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32e98eb-47d4-4376-8d7c-e4b8a023a9f8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c03b9f29-c6ad-415f-97ee-0d7fe414120c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-c03b9f29-c6ad-415f-97ee-0d7fe414120c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c03b9f29-c6ad-415f-97ee-0d7fe414120c" acquired by "delete_volume" :: waited 0.025s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:13 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa Sep 01 11:42:13 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c44f48-4990-4c2e-8d2a-565a301085e3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:13 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c Sep 01 11:42:13 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:13 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" returned: 0 in 0.414s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:13 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:13 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df Sep 01 11:42:13 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:14 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c" returned: 0 in 0.434s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:14 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c Sep 01 11:42:14 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:14 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df" returned: 0 in 0.350s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:14 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df Sep 01 11:42:14 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:14 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-c03b9f29-c6ad-415f-97ee-0d7fe414120c" returned: 0 in 0.252s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c03b9f29-c6ad-415f-97ee-0d7fe414120c" released by "delete_volume" :: held 0.763s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Created reservations ['a319b4d8-b7e4-41c6-a48c-d4cc96c8abb7', '31ccdddb-c21e-4173-b64d-2da1f825f475', '4d3a2b05-5e06-4a4c-b971-4754e896c7ef', '3faaf752-83d4-47c9-82ce-788260c3c826'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:14 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa.fdb7b4f8-0dae-4c6e-80cc-0664977d99df" returned: 0 in 0.259s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:14 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:14 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-fdb7b4f8-0dae-4c6e-80cc-0664977d99df" released by "_delete_snapshot" :: held 1.541s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" released by "delete_snapshot" :: held 1.570s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Created reservations ['63be2c9f-44dc-40ea-a0dd-c58090b4a036', '4d1db96b-5b70-4620-9a23-60d95bfcf51e', '09e0c8b3-35ef-4ef5-b18d-0b14e0e12813', 'c9d8d308-912d-4972-ba40-da546d78fdc7'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:14 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Delete snapshot completed successfully. Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-200309d0-f87b-4fd7-a754-36658ebd55fb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-fdb7b4f8-0dae-4c6e-80cc-0664977d99df-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:14 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.289s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:14 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:42:14 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-6986d743-622f-4b6e-ba1c-c97df792dcf6 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c03b9f29-c6ad-415f-97ee-0d7fe414120c-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (6cd7a318-cc87-4843-8349-f9ff2808b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5663285c-dfaa-438c-8eaa-60f73c086b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5663285c-dfaa-438c-8eaa-60f73c086b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269780256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a3615b-cc3f-4d68-ae45-3bc1017faca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:15Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b0aa28-8157-47fb-991c-d695a979c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b0aa28-8157-47fb-991c-d695a979c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26841b8-8401-463e-aee2-29bbbcc5c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26841b8-8401-463e-aee2-29bbbcc5c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a3615b-cc3f-4d68-ae45-3bc1017faca7', 'volume_name': 'volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf0ee13-36b5-4489-ba3f-c47ff70ca20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf0ee13-36b5-4489-ba3f-c47ff70ca20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222f2aa2-54be-417e-9369-9a57563bc7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:15 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Volume 22a3615b-cc3f-4d68-ae45-3bc1017faca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7', 'volume_size': 1} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269780256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a3615b-cc3f-4d68-ae45-3bc1017faca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:15Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Creating volume 22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:42:15 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:15 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 1073741824 Sep 01 11:42:15 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Acquiring lock "cinder-quobyte-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" acquired by "delete_volume" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b74a88-6ad2-4d30-81e2-d7467798ac46]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:15 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa Sep 01 11:42:15 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:15 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 1073741824" returned: 0 in 0.429s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:15 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" returned: 0 in 0.362s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:15 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa Sep 01 11:42:15 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:15 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 Sep 01 11:42:15 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:15 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" returned: 0 in 0.252s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:15 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-quobyte-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa" released by "delete_volume" :: held 0.669s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:16 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7" returned: 0 in 0.258s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222f2aa2-54be-417e-9369-9a57563bc7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca098da4-71e3-41f7-b069-aba8aefc5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Created reservations ['8cb1bf50-ee7b-4237-ae4a-c018589da7ef', '314b0320-23c8-4d05-866d-14e6bb4344bc', '3626a6ef-d547-4304-9eea-1fe8c08eb63c', 'fd58972e-b518-41e7-a896-bdfb3a9cbabb'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:16 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Volume volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 (22a3615b-cc3f-4d68-ae45-3bc1017faca7): created successfully Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca098da4-71e3-41f7-b069-aba8aefc5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (6cd7a318-cc87-4843-8349-f9ff2808b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-56101a37-af8d-404b-9e41-c96ea330dfbc tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:16 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:16 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:16 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.248s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:16 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Deleted volume successfully. Sep 01 11:42:16 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-aab57ce8-d028-42c2-8419-98b3d6eb91cb tempest-ProjectReaderTests-1157578372 None] Lock "cinder-f6262b3b-92b7-4fc9-acec-b5a9ceed74fa-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot 2246a86b-ba42-4581-85b8-16357681d8a2 of volume 22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[713ffef9-c8ba-4bfb-bc55-73df0cdca940]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:17 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 Sep 01 11:42:17 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:17 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:17 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:17 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 1G Sep 01 11:42:17 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:18 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 1G" returned: 0 in 0.421s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:18 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 Sep 01 11:42:18 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:18 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2" returned: 0 in 0.305s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:18 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 is being set with open permissions: ugo+rw Sep 01 11:42:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:18 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 Sep 01 11:42:18 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:18 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2" returned: 0 in 0.269s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:18 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:18 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info Sep 01 11:42:18 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:19 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info" returned: 0 in 0.255s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:19 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info is being set with open permissions: ugo+rw Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:19 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info Sep 01 11:42:19 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:19 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.info" returned: 0 in 0.253s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:19 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-d1bd7b65-c4be-4085-86e3-24ffb362b9ca tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-2246a86b-ba42-4581-85b8-16357681d8a2-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-2246a86b-ba42-4581-85b8-16357681d8a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-22a3615b-cc3f-4d68-ae45-3bc1017faca7" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-22a3615b-cc3f-4d68-ae45-3bc1017faca7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-2246a86b-ba42-4581-85b8-16357681d8a2" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-2246a86b-ba42-4581-85b8-16357681d8a2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot 2246a86b-ba42-4581-85b8-16357681d8a2 of volume 22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7af3105-6a54-4026-92b8-1fef62500d49]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:19 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 Sep 01 11:42:19 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:19 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2" returned: 0 in 0.363s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:19 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b05b000-3f97-48c7-9cc9-58de278fd7fd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:20 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 Sep 01 11:42:20 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:20 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7" returned: 0 in 0.394s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:20 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 Sep 01 11:42:20 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:20 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2" returned: 0 in 0.321s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:20 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2 Sep 01 11:42:20 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:20 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:20 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7.2246a86b-ba42-4581-85b8-16357681d8a2" returned: 0 in 0.242s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-2246a86b-ba42-4581-85b8-16357681d8a2" released by "_delete_snapshot" :: held 1.411s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-22a3615b-cc3f-4d68-ae45-3bc1017faca7" released by "delete_snapshot" :: held 1.433s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Created reservations ['3ab9d80b-7949-4151-823b-ada0fbf1e7ed', '0ab8a537-cee0-4b80-9624-003c476c19fa', 'f2dd8840-562b-4ecb-97d6-afc9560f9ed8', '3d082ef9-d7d4-43d8-bbc3-9477d900e640'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:21 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-7261a7a5-f876-4fb3-9f39-66ed9a210c32 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-2246a86b-ba42-4581-85b8-16357681d8a2-delete_snapshot" released by "delete_snapshot" :: held 1.559s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-22a3615b-cc3f-4d68-ae45-3bc1017faca7-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-22a3615b-cc3f-4d68-ae45-3bc1017faca7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-22a3615b-cc3f-4d68-ae45-3bc1017faca7" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-22a3615b-cc3f-4d68-ae45-3bc1017faca7" acquired by "delete_volume" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9452d24-1094-493b-8ba5-4c20a2a82573]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:21 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:21 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 Sep 01 11:42:21 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:22 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7" returned: 0 in 0.375s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:22 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7 Sep 01 11:42:22 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:22 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-22a3615b-cc3f-4d68-ae45-3bc1017faca7" returned: 0 in 0.265s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-22a3615b-cc3f-4d68-ae45-3bc1017faca7" released by "delete_volume" :: held 0.698s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Created reservations ['e5946a1e-22e1-413b-825b-6bce1056a616', '036922c7-5007-446c-9104-8e9e9050b336', 'cf790f5a-5f2d-4e0c-8fbb-9b2dca90d229', '0cbca7a7-e9b6-4a56-8322-1efda5f06639'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:22 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:22 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:22 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.252s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:22 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:42:22 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-8dc50732-5033-4316-960f-a34dcd92e014 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-22a3615b-cc3f-4d68-ae45-3bc1017faca7-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (33a7a748-2fcf-4fb1-ac70-6851a16c6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d849149-e50b-420f-bb34-48fdbf959031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d849149-e50b-420f-bb34-48fdbf959031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666136681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906b2872-e62e-425b-8e74-5341ba17ac9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:23Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a2f5bd-e1c0-409b-92f0-091b6fe6877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a2f5bd-e1c0-409b-92f0-091b6fe6877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c413378a-e65d-4347-9498-33da67f11913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c413378a-e65d-4347-9498-33da67f11913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906b2872-e62e-425b-8e74-5341ba17ac9c', 'volume_name': 'volume-906b2872-e62e-425b-8e74-5341ba17ac9c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d1b9d4-b317-43bd-b25f-3d39d0af5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d1b9d4-b317-43bd-b25f-3d39d0af5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db76ed05-455c-4609-8ee4-f4fb12812778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:23 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Volume 906b2872-e62e-425b-8e74-5341ba17ac9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906b2872-e62e-425b-8e74-5341ba17ac9c', 'volume_size': 1} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666136681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906b2872-e62e-425b-8e74-5341ba17ac9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:23Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Creating volume 906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:42:23 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:23 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c 1073741824 Sep 01 11:42:23 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:23 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c 1073741824" returned: 0 in 0.433s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:23 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:23 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c Sep 01 11:42:23 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:24 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db76ed05-455c-4609-8ee4-f4fb12812778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906b2872-e62e-425b-8e74-5341ba17ac9c', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c1087c-bf01-4b4d-9e81-41622c73cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:24 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Volume volume-906b2872-e62e-425b-8e74-5341ba17ac9c (906b2872-e62e-425b-8e74-5341ba17ac9c): created successfully Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c1087c-bf01-4b4d-9e81-41622c73cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (33a7a748-2fcf-4fb1-ac70-6851a16c6806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:24 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-48420b14-66f5-4334-b11c-da95394eaef4 tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot 38c7f9c8-6261-4bbc-903f-e7dff472ccf9 of volume 906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6b95f9-ca33-42cc-8ad2-74106233397b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:24 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c Sep 01 11:42:24 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:24 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c" returned: 0 in 0.351s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:24 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:24 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 1G Sep 01 11:42:24 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:25 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 1G" returned: 0 in 0.394s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906b2872-e62e-425b-8e74-5341ba17ac9c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:25 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906b2872-e62e-425b-8e74-5341ba17ac9c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 Sep 01 11:42:25 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:25 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906b2872-e62e-425b-8e74-5341ba17ac9c -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9" returned: 0 in 0.303s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:25 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 is being set with open permissions: ugo+rw Sep 01 11:42:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:25 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 Sep 01 11:42:25 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:25 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9" returned: 0 in 0.261s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:25 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:25 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info Sep 01 11:42:25 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:26 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info" returned: 0 in 0.255s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:26 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info is being set with open permissions: ugo+rw Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:26 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info Sep 01 11:42:26 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:26 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.info" returned: 0 in 0.263s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:26 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-cac9ea84-fc98-4276-995f-5c99a3412fd5 tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-38c7f9c8-6261-4bbc-903f-e7dff472ccf9-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-38c7f9c8-6261-4bbc-903f-e7dff472ccf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-906b2872-e62e-425b-8e74-5341ba17ac9c" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-906b2872-e62e-425b-8e74-5341ba17ac9c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-38c7f9c8-6261-4bbc-903f-e7dff472ccf9" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-38c7f9c8-6261-4bbc-903f-e7dff472ccf9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot 38c7f9c8-6261-4bbc-903f-e7dff472ccf9 of volume 906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e932dae-ae0d-468d-b36e-9abe7d92e0bc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:26 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:26 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 Sep 01 11:42:26 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:27 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9" returned: 0 in 0.387s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906b2872-e62e-425b-8e74-5341ba17ac9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc3237e-5c26-4bf8-b9b7-ec7385fc1563]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:27 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c Sep 01 11:42:27 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:27 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c" returned: 0 in 0.353s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:27 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 Sep 01 11:42:27 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:27 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9" returned: 0 in 0.316s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:27 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9 Sep 01 11:42:27 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:27 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c.38c7f9c8-6261-4bbc-903f-e7dff472ccf9" returned: 0 in 0.241s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:27 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-38c7f9c8-6261-4bbc-903f-e7dff472ccf9" released by "_delete_snapshot" :: held 1.394s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-906b2872-e62e-425b-8e74-5341ba17ac9c" released by "delete_snapshot" :: held 1.417s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Created reservations ['c28bf79c-de1f-4412-9c3b-09e7c67fd732', '3aaf2047-f1e3-47f2-95b9-d7ada0d9f10f', 'ea55739f-6bb7-440e-ab1e-929be1c7af75', 'e16a5b26-7243-48b6-b9f8-c6e2ecfe2329'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:28 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-3e888831-b050-487a-978d-168e5ab7d54f tempest-ProjectMemberTests-1521081513 None] Lock "cinder-38c7f9c8-6261-4bbc-903f-e7dff472ccf9-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-906b2872-e62e-425b-8e74-5341ba17ac9c-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-906b2872-e62e-425b-8e74-5341ba17ac9c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-906b2872-e62e-425b-8e74-5341ba17ac9c" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-906b2872-e62e-425b-8e74-5341ba17ac9c" acquired by "delete_volume" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bf5c93-c7ec-4a42-a1dd-169e8f7ce1ea]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:28 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:28 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c Sep 01 11:42:28 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:29 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c" returned: 0 in 0.343s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:29 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c Sep 01 11:42:29 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:29 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-906b2872-e62e-425b-8e74-5341ba17ac9c" returned: 0 in 0.241s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-906b2872-e62e-425b-8e74-5341ba17ac9c" released by "delete_volume" :: held 0.638s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Created reservations ['5069c5de-beb9-4b52-8e2f-4c923adf1a5c', '4590f661-45ea-4d1f-aaa9-51759e48be60', '74277a18-34c5-4ca2-9e1a-180fd8c736b2', '6f7025fa-195c-457b-8f73-2b43556aea4e'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:29 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:29 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:29 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.236s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:29 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:42:29 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-c1c3d5d2-8ba3-4819-bb69-b4f1634e66d7 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-906b2872-e62e-425b-8e74-5341ba17ac9c-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (cd7b21f9-f21e-4a8d-a848-484c7bb6bd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811f0713-13d1-475b-a7f3-d0c6e229c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811f0713-13d1-475b-a7f3-d0c6e229c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1311399605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af7e87-49e3-4f70-9147-494bcd0d5efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:30Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc47174-e6d3-4185-be79-7e483c92509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc47174-e6d3-4185-be79-7e483c92509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5450abdf-d917-47c3-a900-0ea0aaf51bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5450abdf-d917-47c3-a900-0ea0aaf51bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0af7e87-49e3-4f70-9147-494bcd0d5efd', 'volume_name': 'volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96f2a6f-74c1-41a0-b0d9-07279c0e7da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96f2a6f-74c1-41a0-b0d9-07279c0e7da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf89d4b-e837-4bdc-8e95-f2c01c255bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:30 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Volume f0af7e87-49e3-4f70-9147-494bcd0d5efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd', 'volume_size': 1} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1311399605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af7e87-49e3-4f70-9147-494bcd0d5efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:30Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Creating volume f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:42:30 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:30 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd 1073741824 Sep 01 11:42:30 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:30 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd 1073741824" returned: 0 in 0.396s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:30 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:30 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd Sep 01 11:42:30 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:31 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd" returned: 0 in 0.259s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf89d4b-e837-4bdc-8e95-f2c01c255bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5d4821-ef2a-4b02-80a1-6c8574df0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:31 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Volume volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd (f0af7e87-49e3-4f70-9147-494bcd0d5efd): created successfully Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5d4821-ef2a-4b02-80a1-6c8574df0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (cd7b21f9-f21e-4a8d-a848-484c7bb6bd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:31 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-be0a411f-e9ba-415a-a980-5ec1016af330 tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot 0a5c337d-412d-4d3c-894f-ce7acc18eac3 of volume f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d74d24c-a9de-4cfa-a8dd-eb1b0de79ec2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:31 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd Sep 01 11:42:31 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:31 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd" returned: 0 in 0.351s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:31 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:31 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 1G Sep 01 11:42:31 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:32 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 1G" returned: 0 in 0.393s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:32 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 Sep 01 11:42:32 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:32 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3" returned: 0 in 0.281s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:32 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 is being set with open permissions: ugo+rw Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:32 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 Sep 01 11:42:32 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:32 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3" returned: 0 in 0.243s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:32 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info Sep 01 11:42:32 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:32 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info" returned: 0 in 0.245s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:32 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info is being set with open permissions: ugo+rw Sep 01 11:42:32 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:33 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info Sep 01 11:42:33 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:33 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.info" returned: 0 in 0.236s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:33 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bac29f7e-731e-4ee3-b075-ae394bb5cc7b tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-0a5c337d-412d-4d3c-894f-ce7acc18eac3-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-0a5c337d-412d-4d3c-894f-ce7acc18eac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-f0af7e87-49e3-4f70-9147-494bcd0d5efd" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-f0af7e87-49e3-4f70-9147-494bcd0d5efd" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-0a5c337d-412d-4d3c-894f-ce7acc18eac3" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-0a5c337d-412d-4d3c-894f-ce7acc18eac3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot 0a5c337d-412d-4d3c-894f-ce7acc18eac3 of volume f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d2092-ea24-43d5-a210-e5010bd64a41]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:33 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 Sep 01 11:42:33 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:33 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3" returned: 0 in 0.354s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563744d-ea2c-4dc7-ba6e-6297878f3bd2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:33 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:34 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd Sep 01 11:42:34 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:34 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd" returned: 0 in 0.345s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:34 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 Sep 01 11:42:34 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:34 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3" returned: 0 in 0.324s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:34 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3 Sep 01 11:42:34 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:34 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd.0a5c337d-412d-4d3c-894f-ce7acc18eac3" returned: 0 in 0.234s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-0a5c337d-412d-4d3c-894f-ce7acc18eac3" released by "_delete_snapshot" :: held 1.338s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-f0af7e87-49e3-4f70-9147-494bcd0d5efd" released by "delete_snapshot" :: held 1.359s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:34 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Created reservations ['62d773b5-2678-4b64-87b2-393d5f5d261e', '51417ff6-b1d9-4126-a96b-3a29df480969', '496d96b0-803e-4df6-a576-ef6ed3498644', '13451b29-83df-4b9d-af03-a8f4549de513'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:35 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-b71cdb2a-bd6a-48c9-82c0-365ced313c99 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-0a5c337d-412d-4d3c-894f-ce7acc18eac3-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-f0af7e87-49e3-4f70-9147-494bcd0d5efd-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-f0af7e87-49e3-4f70-9147-494bcd0d5efd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-f0af7e87-49e3-4f70-9147-494bcd0d5efd" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-f0af7e87-49e3-4f70-9147-494bcd0d5efd" acquired by "delete_volume" :: waited 0.018s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663fabf-0555-4b06-aa1e-4c212ccd80ef]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:35 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:35 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd Sep 01 11:42:35 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:36 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd" returned: 0 in 0.354s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:36 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd Sep 01 11:42:36 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:36 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-f0af7e87-49e3-4f70-9147-494bcd0d5efd" returned: 0 in 0.241s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-f0af7e87-49e3-4f70-9147-494bcd0d5efd" released by "delete_volume" :: held 0.647s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Created reservations ['dd0615c9-79e0-42d3-a117-0708ae87ab2f', 'ab6388e8-1f6c-429c-9a0f-6c2025c84657', '49a51cf5-9684-49a1-aaf4-cdaf52c54e53', '49d5097c-43c4-4c4f-90a4-f8c119d032e4'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:36 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:36 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:36 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.254s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:36 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:42:36 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-316c6b6e-f91c-4d46-bc84-379063f9eb19 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-f0af7e87-49e3-4f70-9147-494bcd0d5efd-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.flows.manager.create_volume [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87144) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (e6dbc71c-2569-45d9-9160-ea89ab8fffe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b45a3-2c32-46d8-b077-2317c828751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b45a3-2c32-46d8-b077-2317c828751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597195374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356464aa-f752-4618-8c13-37d641aef4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:37Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d958f6-c8a7-45b7-87ad-50f2b3fb77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d958f6-c8a7-45b7-87ad-50f2b3fb77c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036fa8b0-aba3-4dbf-8e99-62d4f4e161cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036fa8b0-aba3-4dbf-8e99-62d4f4e161cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356464aa-f752-4618-8c13-37d641aef4df', 'volume_name': 'volume-356464aa-f752-4618-8c13-37d641aef4df', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e914c32-fbd5-4396-a44e-7d2b1148b0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e914c32-fbd5-4396-a44e-7d2b1148b0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a4c2e1-b4b7-4b94-b068-0c6d19540fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:37 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Volume 356464aa-f752-4618-8c13-37d641aef4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356464aa-f752-4618-8c13-37d641aef4df', 'volume_size': 1} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T09:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597195374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356464aa-f752-4618-8c13-37d641aef4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d96bead697448cb6de68e75895faa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T09:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T09:42:37Z,use_quota=True,user_id='764e5c58dedd4d8ebe9610782374edaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebdaece-a469-49dd-8513-5bf741fb8ac1),volume_type_id=3ebdaece-a469-49dd-8513-5bf741fb8ac1)}" {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Creating volume 356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Selected osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 as target Quobyte volume. {{(pid=87144) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 01 11:42:37 devstack cinder-volume[87144]: INFO cinder.volume.drivers.remotefs [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] casted to osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223 Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df 1073741824 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:37 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df 1073741824 Sep 01 11:42:37 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:37 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df 1073741824" returned: 0 in 0.382s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:37 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:37 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df Sep 01 11:42:37 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:38 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df" returned: 0 in 0.244s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'} {{(pid=87144) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a4c2e1-b4b7-4b94-b068-0c6d19540fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356464aa-f752-4618-8c13-37d641aef4df', 'volume_size': 1}' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb0ec9d-7b07-41aa-bab8-ccdad32b7c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 11:42:38 devstack cinder-volume[87144]: INFO cinder.volume.flows.manager.create_volume [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Volume volume-356464aa-f752-4618-8c13-37d641aef4df (356464aa-f752-4618-8c13-37d641aef4df): created successfully Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb0ec9d-7b07-41aa-bab8-ccdad32b7c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87144) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Flow 'volume_create_manager' (e6dbc71c-2569-45d9-9160-ea89ab8fffe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87144) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 11:42:38 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-751f3644-8630-4ac0-96c1-2def554b06f6 tempest-ProjectMemberTests-1521081513 None] Created volume successfully. Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Creating offline snapshot c661fb74-b530-4261-8729-bb6f71b2126a of volume 356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8894c-65e1-4ee1-9fe6-34660b9c5acd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:38 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df Sep 01 11:42:38 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:38 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df" returned: 0 in 0.345s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:38 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a 1G {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:38 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a 1G Sep 01 11:42:38 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:39 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a 1G" returned: 0 in 0.375s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356464aa-f752-4618-8c13-37d641aef4df -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:39 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356464aa-f752-4618-8c13-37d641aef4df -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a Sep 01 11:42:39 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:39 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356464aa-f752-4618-8c13-37d641aef4df -F qcow2 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a" returned: 0 in 0.291s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:39 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a is being set with open permissions: ugo+rw Sep 01 11:42:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:39 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a Sep 01 11:42:39 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:39 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a" returned: 0 in 0.237s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:39 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:39 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info Sep 01 11:42:39 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:40 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info" returned: 0 in 0.243s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:40 devstack cinder-volume[87144]: WARNING cinder.volume.drivers.remotefs [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info is being set with open permissions: ugo+rw Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:40 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info Sep 01 11:42:40 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:40 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.info" returned: 0 in 0.234s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:40 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-4a647ebd-6146-494d-981b-0e7209d863ec tempest-ProjectMemberTests-1521081513 None] Create snapshot completed successfully Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-c661fb74-b530-4261-8729-bb6f71b2126a-delete_snapshot" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c661fb74-b530-4261-8729-bb6f71b2126a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-356464aa-f752-4618-8c13-37d641aef4df" by "delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-356464aa-f752-4618-8c13-37d641aef4df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-c661fb74-b530-4261-8729-bb6f71b2126a" by "_delete_snapshot" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c661fb74-b530-4261-8729-bb6f71b2126a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Deleting offline snapshot c661fb74-b530-4261-8729-bb6f71b2126a of volume 356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] snapshot_file for this snap is: volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a {{(pid=87144) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e7f1f7-c03e-4df2-83df-32d26cbb0f08]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:40 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:40 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a Sep 01 11:42:40 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:41 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a" returned: 0 in 0.346s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-356464aa-f752-4618-8c13-37d641aef4df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87144) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[68922fb6-6c22-42cd-92e8-826bfe7f5406]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:41 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df Sep 01 11:42:41 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:41 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df" returned: 0 in 0.361s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:41 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a Sep 01 11:42:41 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:41 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a" returned: 0 in 0.328s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:41 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:41 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a Sep 01 11:42:41 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:42 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df.c661fb74-b530-4261-8729-bb6f71b2126a" returned: 0 in 0.247s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-c661fb74-b530-4261-8729-bb6f71b2126a" released by "_delete_snapshot" :: held 1.363s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-356464aa-f752-4618-8c13-37d641aef4df" released by "delete_snapshot" :: held 1.389s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Created reservations ['7a9e62a8-7b8f-40fd-bef6-5e74d1cc00aa', 'ccbf7c36-9946-49e2-ba9e-a043a3b3ba96', 'd8a6a9d3-e495-468c-81c0-a0638072e9ad', '4470ed06-3fdd-4903-aad9-6e31330d7424'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:42 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Delete snapshot completed successfully. Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-bd5d168e-bbec-46da-988a-0df9267a4f38 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-c661fb74-b530-4261-8729-bb6f71b2126a-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-356464aa-f752-4618-8c13-37d641aef4df-delete_volume" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-356464aa-f752-4618-8c13-37d641aef4df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "cinder-quobyte-356464aa-f752-4618-8c13-37d641aef4df" by "delete_volume" {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-356464aa-f752-4618-8c13-37d641aef4df" acquired by "delete_volume" :: waited 0.015s {{(pid=87144) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd6eb07-cda7-4ac6-b41a-aca60529f75d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 11:42:42 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:43 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df Sep 01 11:42:43 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:43 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df" returned: 0 in 0.358s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:43 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df Sep 01 11:42:43 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:43 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117/volume-356464aa-f752-4618-8c13-37d641aef4df" returned: 0 in 0.268s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-quobyte-356464aa-f752-4618-8c13-37d641aef4df" released by "delete_volume" :: held 0.682s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG cinder.quota [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Created reservations ['eed077c2-95b6-4531-a225-21250e41088f', 'fbdec2ec-3597-437c-9828-59d185283bc2', '8b11a13a-63b4-414e-9d51-b2b2ba0b4ee6', 'a2b4be3d-2f0f-4ae8-a1fc-89cc6b40d8e1'] {{(pid=87144) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:42:43 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:42:43 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:42:43 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.245s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:42:43 devstack cinder-volume[87144]: INFO cinder.volume.manager [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Deleted volume successfully. Sep 01 11:42:43 devstack cinder-volume[87144]: DEBUG cinder.coordination [None req-1b0d6129-3e7f-4671-b64a-b5fb6dbac3f1 tempest-ProjectMemberTests-1521081513 None] Lock "cinder-356464aa-f752-4618-8c13-37d641aef4df-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87144) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 11:42:53 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=82,cinder:INSERT=31,cinder:UPDATE=112,cinder:DELETE=8 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:42:53 devstack cinder-volume[87144]: DEBUG dbcounter [-] [87144] Writing DB stats cinder:SELECT=91,cinder:DELETE=11,cinder:INSERT=32,cinder:UPDATE=114 {{(pid=87144) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223': None} {{(pid=87144) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG cinder.volume.drivers.quobyte [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1628186-ce10-4476-a5a8-44b7fc86c223'] {{(pid=87144) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.lockutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87144) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:43:04 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117 Sep 01 11:43:04 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:43:04 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_concurrency.processutils [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b7ca69cee1d0405894a0e07707032117" returned: 0 in 0.239s {{(pid=87144) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG cinder.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Notifying Schedulers of capabilities ... {{(pid=87144) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG oslo_service.periodic_task [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] Running periodic task VolumeManager._thread_info {{(pid=87144) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread count: 28 {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:43:04 devstack cinder-volume[87144]: DEBUG cinder.volume.manager [None req-b70b9953-c93b-495a-ae3c-5022f92d040f None None] thread info: [<_MainThread(MainThread, started 128654573863040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87144) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}